Senior Data Engineer Job at Confidential Jobs, New York, NY

eVB4cElwLys0ejdMZXNuZm9DMk5mb1BnV2c9PQ==
  • Confidential Jobs
  • New York, NY

Job Description

This confidential search is being led by Brogan Search Partners for our client. We are the premier recruiters in Product, Engineering and Data for Consumer, Retail, Luxury, DTC in NYC.

About Us

We are a high-end global art company with a presence in New York, London, Los Angeles, Hong Kong, and Paris. Our organization is home to a dynamic program of innovative exhibitions across a range of media and genres. Active in both the primary and secondary art markets, we support a distinguished roster of artists and estates worldwide.

Position Overview

Who We Are:

Our Data Team operates at the intersection of technology, art, and global markets. We manage and continuously evolve the company's data platform, enabling critical functions across Sales, Client Development, Finance, and Operations.

Our core focus areas include:

  • Data Engineering: Build scalable infrastructure, develop data taxonomies, and create analyst-friendly datasets.
  • Data Analysis: Deliver clear insights and actionable recommendations to drive decision-making.
  • Data Products: Develop cutting-edge tools and applications using Generative AI and Machine Learning to unlock new capabilities across the organization.

The Role:

As a Senior Data Engineer , you will architect and implement robust data pipelines, orchestration systems, and ETL processes that support both analytics and AI-driven products. You’ll be responsible for engineering scalable data structures and integrations that enable advanced data use cases, including Generative AI.

Who You Are:

You excel at turning complex or ambiguous business problems into clear engineering solutions. You bring deep expertise in data architecture and modern engineering practices, and you're eager to push boundaries by integrating with Generative AI systems and scalable workflows.

Responsibilities:

  • Design, build, and maintain scalable and reliable data pipelines, ETL frameworks, and orchestration systems.
  • Develop structured datasets, taxonomies, and ontologies to support a range of business and AI applications.
  • Lead the integration of Generative AI into our data platform, including APIs and retrieval-augmented generation (RAG) methodologies.
  • Partner with analysts, product teams, and stakeholders to ensure data solutions are actionable and aligned with business needs.
  • Provide technical leadership on scalability, architecture, and integration of new data-driven tools and products.

Requirements:

  • Proven experience with data engineering, pipeline architecture, ETL systems, and orchestration tools (e.g., DBT, Airflow).
  • Expertise in Python, SQL, and modern data infrastructure (e.g., Databricks, Snowflake, AWS, GCP).
  • Strong background in data modeling, ontology design, and semantic data concepts.
  • Hands-on experience integrating Generative AI tools and APIs into data systems.
  • Experience with RAG and related AI techniques strongly preferred.
  • Excellent communication skills for both technical and non-technical audiences.

What We Offer:

  • An intellectually and culturally rich environment where your technical work drives innovation.
  • High autonomy and the chance to shape next-generation data capabilities within the art industry.
  • A unique opportunity to pioneer data products at the intersection of art, technology, and global commerce.

Location: NYC (Headquarters)

Job Tags

Worldwide,

Similar Jobs

Plum Inc

Senior Data Engineer Job at Plum Inc

 ...building successful startup businesses, including GetSmart.com , Xing and Trivago. Our team includes senior leaders and talent from AIG, Goldman Sachs, KKR, PWC, Bank of America, Meridian Capital, JP Morgan, Freddie Mac, US Bank, Truist Bank, Guggenheim, Trimont, and... 

Microsoft Corporation

Regional Security Operations Manager Job at Microsoft Corporation

 ...cultivating an inclusive work environment for all employees to positively impact our culture every day and we need you as a **Regional Security Operations Manager.**As a Regional Security Operations Manager in CO+I Physical Security, you will be part of a global team dedicated... 

Dynamis, Inc.

Emergency Management Specialist Job at Dynamis, Inc.

Dynamis is seeking a Mid-Level Emergency Management Specialist to support the design, development, conduct, and evaluation of discussion- and operations-based exercises for a DHS agency pursuant to the Homeland Security Exercise & Evaluation Program (HSEEP). The EM Specialist... 

System One

Part Time Paralegal Job at System One

 ...Part-time Paralegal Assignment Focus: System One is partnering with a client to hire...  ...Paralegal. The Paralegal will support the Chief Legal Officer in managing, drafting, reviewing,...  ..., and corporate contract files. Assist with renewals of expiring company agreements... 

Atarid Specialist Recruiters

Training Manager - Affordable Housing Job at Atarid Specialist Recruiters

 ...management company, hiring an: Training Manager - Develop, implement, and oversee the training programs for all staff within affordable housing. Job Id#: EB-1787564340 Job Responsibilities: Responsible for development, implementation, delivery, and oversight of...