Job Description

Role: AZURE DATA ENGINEER

Location: Weehawken, NJ - 5 days onsite (Need Local Candidates from NY, NJ)

Client: Infosys/UBS
Need PP no. as well !!

Duration: 12 Months

Experience: Need 10+ Years experience

Job Details:

We are seeking a skilled Azure Data Factory Engineer/Developer with strong PostgreSQL knowledge to design, develop, and maintain data pipelines for extracting, transforming, and loading (ETL) data from various sources, including PostgreSQL databases, into Azure data platforms

• Design, Develop, and Maintain ADF Pipelines:
  • Design, develop, and maintain robust and efficient ADF pipelines for data ingestion, transformation, and loading from PostgreSQL databases and other sources.
  • Optimize ADF pipelines for performance, scalability, and reliability.
  • Develop and implement data quality checks and validation rules within ADF pipelines.
• PostgreSQL Expertise:
  • Proficiently use SQL to query, manipulate, and extract data from PostgreSQL databases.
  • Understand PostgreSQL database architecture, performance tuning, and best practices.
  • Troubleshoot and resolve issues related to PostgreSQL connectivity, performance, and data integrity.
• Data Integration and Transformation:
  • Design and implement data transformation logic within ADF pipelines, leveraging various ADF activities and connectors.
  • Develop and maintain data mappings and transformations to ensure data consistency and quality.
  • Collaborate with data engineers and business stakeholders to understand data requirements and implement solutions.
• Monitoring and Optimization:
  • Monitor the performance and health of ADF pipelines and PostgreSQL databases.
  • Identify and resolve performance bottlenecks and data quality issues.
  • Implement and maintain monitoring and alerting mechanisms for ADF pipelines and PostgreSQL databases.
• Skills:
• Azure Data Factory (ADF): Strong experience in designing, developing, and maintaining ADF pipelines.
• PostgreSQL: Extensive knowledge of PostgreSQL database architecture, SQL, and performance tuning.
• SQL: Proficient in writing and optimizing SQL queries.
• Data Modeling: Experience in designing and implementing data models.
• ETL/Data Integration: Experience with ETL processes and data integration tools.
• Cloud Computing: Familiarity with Azure cloud services and technologies.
• Problem-Solving: Strong analytical and problem-solving skills.
• Communication: Excellent communication and collaboration skills.

Feel Free to reach out to me on anjali08@kanakits.com

Job Tags

Similar Jobs