Lead Databricks Solutions Architect (100% Remote)

About the role

Job Description

Insight Global is looking to hire a Lead Databricks Solutions Architect sitting remotely to operate as both a strategic leader and a hands-on technical resource, helping guide how Databricks is implemented and expanded across DHS. This includes supporting the design, implementation, and long-term operation of Databricks throughout the environment. This person will work closely with stakeholders during the initial implementation and transition into owning architectural decisions, best practices, and the continued evolution of the platform. Prior experience supporting Databricks implementations at DHS agencies is critical to being successful in this role.

Responsibilities Include: • Lead the architecture, implementation, and long-term operation of Databricks on AWS in an enterprise environment • Build and productionize solutions for federal customers using Databricks • Provide unification for organization and enterprise data capabilities to break down organizational data and operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouse • Support the integration of Databricks with existing analytics platforms and metadata solutions • Serve as a technical advisor to stakeholders and help upskill internal teams through guidance/documentation • Assist and develop customer use case applications of Databricks • Provide input on onboarding federal customers new to Databricks

Compensation: $90.21/hr to $96.15/hr.

Exact compensation may vary based on several factors, including skills, experience, and education.

Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.

Skills and Requirements

• Ability to obtain a DHS EOD security clearance • 7+ years of hands-on experience architecting, designing, data engineering with Databricks and AWS in a government setting • Previous technical lead experience • Extensive experience supporting Databricks implementations at DHS agencies (e.g., CBP, USCIS, FEMA, ICE, USCG) • Experience with Unity Catalog and MLFlow within Databricks • Experience with agentic AI tools such as Databricks' Genie and Agent Bricks • Experience integrating Databricks with other analytics platforms • Strong understanding and experience in areas such as Apache Spark, Lakebase, Lakehouse architectures, Delta Lake, Delta Sharing, Medallion Architecture, Data & AI Governance, and use case acceleration • Working knowledge of both AWS and Azure ecosystems with demonstrated hands-on experience with cloud native data and ETL capabilities (S3, Lambdas, Glue, etc.) • Demonstrated experience leveraging data to provide search, enrichment, correlation, AI/ML Model Training, in alignment with government mission and business use cases • Prior consulting or customer-facing experience in data architecture or modernization initiatives. • Strong Python skills • Experience in Agile environments and managing cross-functional technical delivery • Experience supporting federal customers and federal platforms (e.g., knowledge of GovCloud, FISMA, etc.) • Familiarity with CI/CD • At least one Databricks certification (Associate or Professional Data Engineer certifications preferred) • Prior experience supporting DHS • Experience with the DHS System Engineering Lifecycle (SELC) • Familiarity with the concepts of a data mesh • AWS Solutions Architect Associate or Solutions Architect Professional Certification • Azure Associate certifications (AZ-204, DP-203) • Familiarity with Databricks Apps • Experience building reference architectures, playbooks, or platform documentation • Experience with metadata platforms (e.g., OpenMetaData, Collibra) and integrating Databricks with them • Prior experience as a Databricks Resident Solutions Architect/Forward Deployed Engineer

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Posting text as published by Insight Global.

The evidence behind this listing

Workplace

Remote Matched in posting text

Seniority

senior From the job title

Employment type

Not established

Location as listed

Arlington, VA

Pay and work authorization

Stated pay

$90–96/hr AI reading of the posting

Visa sponsorship

Not stated

Security clearance

Required

Citizenship

Not established