Data Quality Tester Databricks (m/f/d)
Über uns
IT is and always has been our core business that laid the foundation for Hays' success. We are the biggest privately owned IT recruitment agency in Germany and offer the best jobs for every career level – whether you are interested in vacancies in agile SMEs or international DAX groups. Hays masters the entire IT job spectrum, from support to software architecture or digitalisation – thanks to our broad portfolio, we have something for everyone. In the last decades, we were able to support numerous IT experts with choosing the right path for a successful career, positioning ourselves as their lifelong partner. Our highly specialised consultants can cater to your every wish and expectation and will prepare you for interviews and contract negotiations. Give it a try and learn what the market has to offer – our services are free of charge, non-binding and discreet! We look forward to hearing from you.Aufgaben
- Develop and execute automated data and integration tests in Databricks (Python, PySpark, SQL)
- Conduct end-to-end pipeline testing from SCADA through AMQP into Databricks, including verification of transformation logic and compliance with defined business rules
- Capture, store, and prepare test results using Azure services (Data Lake, Blob Storage, SQL)
- Integrate automated tests into CI/CD pipelines with Azure DevOps, collaborating closely with DevOps and Cloud teams to ensure continuous validation and monitoring
- Work closely with Data Engineers, SCADA specialists, and Cloud architects, ensuring full documentation of all test cases, procedures, and outcomes for transparency and traceability
Profil
- Knowledge of Python, PySpark/SQL
- Knowledge of Databricks
- Knowledge of Azure Services for storing and prepare results
- Knowledge of Azure DevOps
- Knowledge of SCADA is advantageous
Wir bieten
- Start date: asap
- Remote-option
Ihr Kontakt
Referenznummer
859596/1
Kontakt aufnehmen
Telefon:+ 49 621 1788-4297
E-Mail: positionen@hays.de
Anstellungsart
Freiberuflich für ein Projekt