Senior Data Engineer
Citigroup · Pune
The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
Responsibilities:
- Develop data warehouse, develop data as a product, lead architect and solution, development, maintenance of scalable and secure data architecture to support downstream and reporting application and data integration, and simplify complex data processes utilizing best engineering practices and data lifecycle management
· Develop data models, taxonomies, metadata, data mappings, data standards, versioning, and semantic layers for domains and data products and support data consumption, AI and regulatory requirements.
· Build automated data integration solutions and data pipelines including reference data to meet business and reporting requirements
- Exhibit strong leadership qualities, fostering a positive and collaborative work environment, providing guidance and mentorship to team members, and promoting a culture of continuous learning.
· Implement data governance and management, quality standards and data controls to ensure data accuracy and security so downstream applications can consume data confidently. Manage and maintain data process documentation
· Define Contribute to technical direction and enhancement as a technical expert in data development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutions
- Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions.
- Contribute to CI/CD implementation using DevOps best practices and ensure robust testing framework is utilized for functional and nonfunctional testing for the release cycles based on industry and Citi standards and work to implement them.
- Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions.
· Contribute to technical direction and strategic decisions as a technical expert in all development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutions
- Demonstrate a data-driven approach to problem-solving and decision-making, utilizing metrics, and performance indicators to assess team efficiency and identify improvement opportunities.
- Manage and maintain data processes and jobs. Partner with Support team to ensure stability of production environment with proactive monitoring and health checks.
- Partner with other Citi development teams to build APIs, integrations and share components that are critical to our platform’s success.
Qualifications:
- Strong experience in designing and building best in class enterprise data engineering excellence in a highly matrixed, complex organization
- Strong experience in architecting complex end-to-end data pipelines in a highly available, distributed systems of data extraction, ingestion, processing of large data sets.
- Strong hands-on in advanced development experience in large database, complex data models, procedures, error handling, performance tuning/profiling, data security, database optimization and configurations.
- Solid experience in complex data integration
- Strong experience in large complex physical and logical data model design and development for data warehouse, reporting and reference and master data.
- Hands-on experience with complex data integration and developing scalable, high-volume data pipelines using APIs, Python, Airflow, and Spark
- Experience in data mesh technologies Trino/Starburst, S3, distributed stream processing Kafka
- Strong experience in developing data quality and reconciliation controls, data lineage and data catalog documentations, data control monitoring and proactively identify and resolve data inconsistency and gaps
- Excellent verbal and written communication skills, enabling effective collaboration with cross-functional teams, stakeholders, and management.
- Strong hands-on experience in S3, Starburst, Oracle database, Databricks and Snowflake preferred.
- Strong hands-on experience with modern software paradigms including cloud-native (AWS, Docker) and microservices
- Experience in implementation of DevOps such as CI/CD and modern best practices such as testing frameworks and the SOLID principles; CI/CD tooling, automation of testing tools
- Passion and commitment for adopting new technologies with exploratory mind-set
- Experience working in an Agile/Scrum work environment
- Experience in building observability and monitoring for data processes and jobs
- Innovative ideas and can-do attitude to work under pressure
- Experience in building data quality control and monitoring
- Understanding trading data and experience working in the financial services is required
- Proficiency with modern AI coding and testing tools
- Development DBA experience in a plus.
Recommended Qualifications:
- 7 to 10 years of relevant experience
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Working knowledge of consulting/project management techniques/methods
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Education:
- Bachelor’s degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
------------------------------------------------------
Job Family Group:
Technology------------------------------------------------------
Job Family:
Applications Development------------------------------------------------------
Time Type:
Full time------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.