AWS Databricks Developer
SAIC · College Park
Position Overview
We are seeking a AWS Databricks Developer to build and maintain scalable data pipelines on AWS. This role will turn data from databases, APIs, and files into reliable datasets for analytics and business reporting.
Responsibilities:
Develop batch and incremental ETL/ELT pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
Build and maintain Bronze, Silver, and Gold data layers using Medallion Architecture.
Ingest and transform structured and semi-structured data from sources such as Oracle, SQL Server, REST APIs, and Amazon S3.
Implement data quality checks, including schema validation, deduplication, reconciliation, and business rule enforcement.
Optimize Spark jobs and Delta tables to improve processing time and control cloud resource use.
Publish curated datasets to Amazon Redshift and support reporting in Power BI, Tableau, or Amazon QuickSight.
Orchestrate, monitor, and troubleshoot production pipelines using Databricks Workflows, Apache Airflow, and AWS monitoring services.
Collaborate with analysts, architects, QA, and DevOps teams on requirements, releases, and production support.
We are approximately 23,000 strong; driven by mission, united by purpose, and inspired by opportunities. SAIC is an Equal Opportunity Employer. Headquartered in Reston, Virginia, SAIC has annual revenues of approximately $7.3 billion. For more information, visit saic.com. For ongoing news, please visit our newsroom.
More jobs at SAIC · Software Engineering jobs in College Park