Collibra Data Lineage Automation Engineer Job at Alignity Solutions, Mc Lean, IL

Yzh2eCtMK05SNEh1cjU4d3l4Q2JHZm1xcEE9PQ==
  • Alignity Solutions
  • Mc Lean, IL

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the   meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Collibra  Data Lineage Automation Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title:  Collibra  Data Lineage Automation Engineer

Location: Onsite – 5 days/week in McLean, VA

Work Type: 1099 / C2C / W2

Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra  Data Lineage Automation Engineer   to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI/ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

  • Lead the implementation of automated lineage across diverse systems:

    • Cloud platforms (e.g., Snowflake, AWS )

    • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

    • NoSQL databases (e.g., MongoDB)

    • BI/reporting tools (e.g., Tableau, Power BI)

  • Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

  • Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

  • Integrate lineage with metadata/governance platforms ( Collibra, Alation ) to ensure usability and traceability.

  • Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

  • Develop reusable lineage components and promote automation-first, reusable design principles.

  • Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

  • Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

  • Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

  • Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

  • Strong AI/ML background , with experience in:

    • Metadata intelligence

    • NLP-based code parsing

    • Pattern detection in lineage gaps

  • Programming expertise in Python, Scala, or Java .

  • Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

  • Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

  • Hands-on experience with commercial lineage tools (evaluation or implementation).

  • Background in regulated industries (finance, healthcare, insurance).

  • Familiarity with event-driven architectures for real-time lineage propagation.

  • Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

  • Has successfully delivered automated lineage at enterprise scale .

  • Operates at the intersection of data engineering, metadata management, and AI innovation .

  • Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

  • Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at  . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message:   Click Here

Clients Testimonial:   Click Here

Job Tags

Contract work, H1b,

Similar Jobs

The IMA Group

Psychiatric Nurse Practitioner/Physician Assistant (Clinical Research) - Manhattan, NY Job at The IMA Group

 ...administer clinical efficacy scales to participants with various psychiatric and neurologic diagnoses, perform diagnostic evaluations...  ...is a licensed Psychiatric Nurse Practitioner (NP), or Physician Assistant (PA) with relevant clinical and/or research experience, eager... 

Pro-Pipe Professional Pipe Services

Class A Vacuum Truck Operator Job Job at Pro-Pipe Professional Pipe Services

Class A Vacuum Truck Operator JobVactor OperatorPro-Pipe is the largest CCTV (closed-circuit television) inspection company in the Western U.S. Were focused on the long-term commitment of our services to facility owners, government agencies, engineers, construction... 

Kooner Fleet Management Solutions

Entry-Level Diesel Mechanic/Technician (1652) Job at Kooner Fleet Management Solutions

 ...Are you an Entry-Level Diesel Technician looking to advance your career? If so, Kooner Fleet Management Solutions wants you to join our growing team! We're looking for a motivated...  ...providers of fleet maintenance and emergency repair services in the United States. Our... 

Black Beach Studio

3D Modeler Job at Black Beach Studio

Black Beach Studio, The VR Studio behind IRON REBELLION, is looking for a talented 3D Artist to bring our biggest dreams for the game to life! We are looking to expand our VR Mech Game, IRON REBELLION, to new heights over the next year as we look to add highly requested...

Bedford Staffing

Personal Assistant Job at Bedford Staffing

Job Type: Permanent Title: Personal Assistant Compensation: Up to $160K Hours: 9 to 5 M-F Location: Beverly Hills The owner of...  ...his home and projects, run errands, supervise the staff, book travel, plan events, and arrange his social calendar....