Data & AI - Services

Azure Data Engineer

Apply Now Share
Azure Data Engineer

Experience: 5+ Years

Azure Data Engineer
  • PAN India

Capabilities

  • Experience of at least 5+ Years as an ETL/Hadoop/Azure Cloud Engineer in various Development Projects. Candidate should have worked in the respective Projects as part of his/her recent Projects
  • In-depth project development experience in Hadoop, ETL and Azure Cloud technologies (Azure Databricks, Azure Data Factory, Azure Data lake, Blob Storage, Synapse, CosmosDB)
  • Experience in Ingestion of batch and Streaming data with complex transformations using Apache Kafka, Apache Spark, Scala, Hive SQL, Shell Script.
  • Work directly with Business users and convert use cases into solutions independently.
  • Experience in working with very large volume of log data and building analytical insights based on user requirements
  • Experience in handling Semi-structured data in various data formats (Parquet, JSON, Avro, Orc) and manipulate data in complex data types.
Secondary Skills:
  • Knowledge on Devops tools and experience in building CI/CD pipelines on Azure.
  • Write programs to pull data from External Applications and Services using REST API with different authentication methods.
  • Knowledge on nosql database types like Document and Graph DB is a plus.
  • Knowledge on Machine Learning Libraries for Data science and analytics is a plus.
  • Has worked in Agile methodologies
  • Bachelor of Engineering, Bachelor Computer Science or Master’s Degree

Qualifications

A Master’s or Ph.D. in a related field, such as Computer Science, Data Science, or a similar discipline.

Your Team

You join a pioneering journey with an Indian multinational IT services and consulting company, headquartered in Pune. Here, you’ll be part of shaping the connected world, delivering innovative and customer-centric IT experiences. Your role goes beyond a job—it’s an opportunity to contribute to transformative technology solutions. Imagine working in a dynamic environment where innovation thrives, and your skills make a real impact. This company values your ideas, offering a platform for professional growth and meaningful contributions to the ever-evolving landscape of information technology. Welcome to a career where your potential meets limitless possibilities, making a significant impact on the digital future.

Your Job

In your role as a Data Engineer, you will spearhead the construction of our Enterprise Data platform with a methodical approach. Your primary focus will be on establishing data pipelines characterized by scalability, robustness, and resilience. This involves meticulously crafting pipelines for the validation, ingestion, normalization/enrichment, and business-specific processing of healthcare data. Your expertise will extend to building an Azure Data Lake, strategically utilizing Databricks technology. This pivotal step aims to consolidate data from across the entire organization, creating a centralized repository.

Your methodical approach ensures that these pipelines not only meet current needs but are also adaptable for future growth and evolving data requirements. As you architect the Azure Data Lake, your attention to detail will be crucial in ensuring it becomes a comprehensive and dynamic source, serving data effectively to various products and services within the company.

This role demands a meticulous mindset, where each aspect of the data engineering process is approached with precision and attention to detail. Your methodical approach will contribute significantly to the success of our data-driven initiatives, enabling the organization to harness the full potential of its healthcare data for informed decision-making and strategic advancements.

Similar Jobs

View Other Jobs

Let’s Elevate
Excellence

Connect