Python and Apache Spark Big Data Engineer - Assistant Vice President
Citigroup · Pune
Experience Range - 8 to 12 years
Strong experience with one or more programming languages (Python/Spark).
- Demonstrated analytical and problem-solving skills. Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain.
- Comfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniques.
- Experience in Big data technologies like HDFS, Map Reduce, YARN, Apache Spark, Hive.
- Familiarity with data formats like Avro, Parquet, CSV, JSON.
- Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities.
- Understanding fundamental design principles behind a scalable application.
- Experience in working with UNIX/LINUX and shell scripting.
- Good knowledge of database principles, practices with SQL.
- Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. Good to Have:
- Agile/Scrum methodology experience is required.
- Experience in SCMs like GIT and tools like JIRA.
- Experience in No SQL databases.
- Familiarity with build tools such as Maven and continuous integration like Jenkins/Team City.
- Familiarity with cloud and container technologies.
- Experience real time data processing - Kafka.
Responsibilities:
- Translate application storyboards and use cases into functional applications.
- Design, build, and maintain efficient, reusable, and reliable Python/Scala code.
- Ensure the best possible performance, quality, and responsiveness of the applications.
- Identify bottlenecks and bugs, and devise solutions to these problems.
- Develop high performance & low latency components to run Spark clusters.
- Interpreting functional requirements into design approaches those can be served through Big Data platform.
- Collaborate and partner with Global Teams based across different locations.
- Be able to propose best practices and standards.
- Perform the testing of software prototypes and transfer to the operational team.
- Processing of data using Hive, Impala & HBASE.
- Performing analysis of large data sets and derive insights.
------------------------------------------------------
Job Family Group:
Technology------------------------------------------------------
Job Family:
Applications Development------------------------------------------------------
Time Type:
Full time------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.