Data Engineer
Kforce Inc

Job Info

---

RESPONSIBILITIES:

Kforce has a client that is seeking a Data Engineer in New York, NY.Summary:As a Data Engineer, you will be a part of an early stage team that builds the data transport, collection, and storage, and exposes services that make data a first-class citizen. We are looking for a Data Engineer to build a scalable data platform. Responsibilities:

• Ownership of our core data pipeline that powers our top-line metrics
• Use data expertise to help evolve data models in several components of the data stack
• Help architect, building, and launching scalable data pipelines to support our growing data processing and analytics needs
• Your efforts will allow access to business and user behavior insights, using huge amounts of data to fuel several teams such as Analytics, Data Science, Marketplace, and many others
• You will report to a Data Engineering Manager
• Owner of the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth
• Evolve data model and data schema based on business and engineering needs
• Implement systems tracking data quality and consistency
• Develop tools supporting self-service data pipeline management (ETL)
• SQL and MapReduce job tuning to improve data processing performance

REQUIREMENTS:

• 5+ years of relevant professional experience
• 1+ years of experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
• Strong experience with Spark
• Experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
• Experience working on safety systems
• Experience working with ADP Live Agent (not a must-have)
• Strong skills in a scripting language (Python, Ruby, Bash)
• Good understanding of SQL Engine and able to conduct advanced performance tuning
• Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
• Comfortable working directly with data analytics to bridge Lyft's business goals with data engineering

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

This job has expired.