Collibra Data Lineage Automation Engineer Job at Alignity Solutions, Mc Lean, IL

Yzh2eCtMK05SNEh1cjU4d3l4Q2JHZm1xcEE9PQ==
  • Alignity Solutions
  • Mc Lean, IL

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the   meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Collibra  Data Lineage Automation Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title:  Collibra  Data Lineage Automation Engineer

Location: Onsite – 5 days/week in McLean, VA

Work Type: 1099 / C2C / W2

Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra  Data Lineage Automation Engineer   to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI/ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

  • Lead the implementation of automated lineage across diverse systems:

    • Cloud platforms (e.g., Snowflake, AWS )

    • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

    • NoSQL databases (e.g., MongoDB)

    • BI/reporting tools (e.g., Tableau, Power BI)

  • Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

  • Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

  • Integrate lineage with metadata/governance platforms ( Collibra, Alation ) to ensure usability and traceability.

  • Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

  • Develop reusable lineage components and promote automation-first, reusable design principles.

  • Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

  • Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

  • Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

  • Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

  • Strong AI/ML background , with experience in:

    • Metadata intelligence

    • NLP-based code parsing

    • Pattern detection in lineage gaps

  • Programming expertise in Python, Scala, or Java .

  • Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

  • Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

  • Hands-on experience with commercial lineage tools (evaluation or implementation).

  • Background in regulated industries (finance, healthcare, insurance).

  • Familiarity with event-driven architectures for real-time lineage propagation.

  • Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

  • Has successfully delivered automated lineage at enterprise scale .

  • Operates at the intersection of data engineering, metadata management, and AI innovation .

  • Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

  • Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at  . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message:   Click Here

Clients Testimonial:   Click Here

Job Tags

Contract work, H1b,

Similar Jobs

NTT DATA, Inc.

Helpdesk Senior Associate - ITIL Job at NTT DATA, Inc.

Senior Service Desk Associate English India - Office working (Office and Office (Office and Remote)) Competitive Salary & Benefits Role Overview The Service Desk SeniorAssociate advises and assists users over the phone/chat/email in solving problems related... 

Vensure Employer Solutions

Business Consultant - MI Job at Vensure Employer Solutions

 ...solutions, including HR/HCM technology, managed services, and global business process outsourcing (BPO). The company and its service...  ...efficiency of all services for assigned clients Attend monthly consulting meetings and offer training and coaching for staff... 

Cabela's

Lead Power Sports Sales Full-Time Job at Cabela's

 ...POSITION SUMMARY: The TMBC Power Sports Sales Lead assists the Marine Group Sales Manager provide daily direction to include merchandise...  ...performing selling and customer service activities to assist Boat and ATV customers in making informed buying decisions. ESSENTIAL... 

NORFOLK TRUCK CENTER

***PART-TIME*** CDL Quality Test Driver Job at NORFOLK TRUCK CENTER

We are currently seeking a part time CDL Quality Test Driver to join our growing Hampton team.At Norfolk Truck Center we are committed to providing our employees with the knowledge to become as successful as they want in their careers. We are a family owned business... 

TheraEd Staffing Group

Board Certified Behavioral Analyst - School Job at TheraEd Staffing Group

 ...We are seeking a dedicated and experienced Board Certified Behavior Analyst (BCBA) to provide school-based behavioral support for students in Dover, DE. This is an excellent opportunity to apply your expertise in Applied Behavior Analysis (ABA) while helping students on...