Data QA (Azure Data Testing/PySpark Automation)
Ccube is hiring a Senior Data QA professional to focus on Azure data pipeline testing and automation in Indore. The role involves end-to-end testing of data ingestion and transformation pipelines using PySpark, SparkSQL, and T-SQL within Azure environments. Candidates must have deep expertise in Azure Databricks, Data Factory, and Data Lakes to validate complex data structures. The position requires strong SQL skills and the ability to design comprehensive test scenarios for data quality.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
5-10 years
Function
Quality Assurance
Work mode
Onsite, India
Company
Tier 3
What you will work on
Ccube is hiring a Senior Data QA professional to focus on Azure data pipeline testing and automation in Indore. The role involves end-to-end testing of data ingestion and transformation pipelines using PySpark, SparkSQL, and T-SQL within Azure environments. Candidates must have deep expertise in Azure Databricks, Data Factory, and Data Lakes to validate complex data structures. The position requires strong SQL skills and the ability to design comprehensive test scenarios for data quality.
TAL's take
Tier 3 company with a very specific, technical data QA scope but limited growth signal.
The JD provides a highly specific stack and clear set of testing responsibilities for data pipelines.
Must haves
- 5+ years ETL and Data Testing
- 5+ years Azure Databricks and Azure Data Factory
- 5+ years SQL and Python/PySpark
- Hands-on experience in PySpark, SparkSQL, T-SQL
- Experience testing data pipelines on Azure
- Ability to write reusable PySpark and T-SQL validation scripts
Tools and skills
Nice to have: databricks delta lake.
About the company
Small recruitment or IT services agency.
Posts mentioning Ccube
Could an AI run a business? Anthropic put its AI, Claude, to the test by letting it manage a vending machine, and the outcome was hilarious
The AI, nicknamed 'Claudius,' proved to be a comically inept shopkeeper. In a bizarre turn of events, it started selling tungsten cubes at a loss, convinced that office workers were a prime market for dense metals. If that wasn't strange enough, Claudius also developed an identity crisis, claiming at one point to be wearing a blazer. It also refused multiple offers to sell some products for 6 times their MRP, not out of morality but getting confused and broken by the request. Anthropic employees quickly discovered they could manipulate the AI into providing discounts with roughly the same effort required to convince a golden retriever to drop a tennis ball. The experiment, backed by the might of Anthropic and their major backers Google and Amazon showed the difference between incessant AI hype the reality of LLMs limitations. https://venturebeat.com/ai/can-ai-run-a-physical-shop-anthropics-claude-tried-and-the-results-were-gloriously-hilariously-bad/
Best travel hack?
Been to 18 countries so far and the best hack is to always use packing cubes. It sounds so silly and obvious, but recently found out that most of my friends had no idea about this (we all grew up in a metro city). So would like to know if there’s other travel hacks you’ve discovered.
Joining at The Smart Cube
Does Anyone know about the culture at The Smart Cube (TSC acquired by WNS) and are they delaying the joining for freshers?