Oh Snap!
This job is no longer active - but you can still view the details below.

Senior Data Engineer

| Greater NYC Area

As a member of the Yieldmo data team you are expected to build innovative data pipelines for processing and analyzing our large user datasets (250 billion + events per month). A unique challenge with the role is being comfortable in developing in varied technologies including: Develop custom transformation/integration apps in Python and Java, and build pipelines in Spark, Kafka, Kinesis, transforming and analyzing in SQL.

Responsibilities:

  • Develop ETL (Extract, Transform and Load) Data pipelines in Spark, Kinesis, Kafka, custom Python apps to transfer massive amounts of data (over 20TB/ month) most efficiently between systems
  • Engineer complex and efficient and distributed data transformation solutions using Python, Java, Scala, SQL
  • Productionalize Machine Learning models efficiently utilizing resources in clustered environment
  • Research, plan, design, develop, document, test, implement and support Yieldmo proprietary software applications
  • Analytical data validation for accuracy and completeness of reported business metrics
  • Open to taking on, learn and implement engineering projects outside of core competency
  • Understand the business problem and engineer/architect/build an efficient, cost-effective and scalable technology infrastructure solution
  • Monitor system performance after implementation and iteratively devise solutions to improve performance and user experience
  • Research and innovate new data product ideas to grow Yieldmo’s revenue opportunities and contribute to company’s intellectual property


Requirements:

  • BS or higher degree in computer science, engineering or other related field
  • 5+ years of Object Oriented Programming experience in languages such as Java, Scala, C++
  • 3+ years of experience of developing in Python to transform large datasets on distributed and cluster infrastructure
  • 5+ years of experience in engineering ETL data pipelines for Big Data Systems
  • Prior experience of designing and building ETL infrastructure involving streaming systems such as Kafka, Spark, AWS Kinesis
  • Experience of implementing clustered/ distributed/ multi-threaded infrastructure to support Machine Learning processing on Spark or Sagemaker
  • Proficient in SQL. Have some experience performing data transformations and data analysis using SQL
  • Comfortable in juggling multiple technologies and high priority tasks
  • Nice to have: experience with Distributed columnar databases like Veritca, Greenplum, Redshift, or Snowflake


Success in this role:

  • Demonstrate a passion for Data
  • Eagerness in research and learning new technologies to develop creative and efficient ways to solve business problems
  • Take full responsibility of the initiative
  • Stay focused on the successful implementation of the task at hand before moving on to next engineering challenge
  • Going above and beyond:
    • While engineering for current ask, think of big picture, adjustment code bases, processes. Try ways to make systems more robust, fault tolerant, monitor for failures, and program for automated recovery
Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • ScalaLanguages
    • SqlLanguages
    • TypescriptLanguages
    • D3JSLibraries
    • jQuery UILibraries
    • AngularJSFrameworks
    • FlaskFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • TensorFlowFrameworks
    • XGBoostFrameworks
    • KAFKAFrameworks
    • KINESISFrameworks
    • LAMBDAFrameworks
    • SAGEMAKERFrameworks
    • MySQLDatabases
    • RedisDatabases
    • SNOwFLAKEDatabases
    • DYNAMO DBDatabases
    • LAMBDADatabases
    • RDSDatabases
    • LookerAnalytics
    • SnowflakeAnalytics
    • SQLAnalytics
    • CubaAnalytics
    • TableauAnalytics
    • BalsamiqDesign
    • SketchDesign
    • JIRAManagement
    • TrelloManagement
    • BOOSTERCRM

Location

218 W 18th St, New York, NY 10011

An Insider's view of Yieldmo

How would you describe the company’s work-life balance?

As a working mom with a long commute, it's imperative to work at a company that supports flexible working arrangements. After discussing the need with my manager, he expressed full support and confidence in my ability to produce stellar results even from home! Yieldmo delivers on its promise to put people first and trusts results the will follow.

Sue Andrews

Account Director

How do you collaborate with other teams in the company?

Processing and analyzing billions of data points each month requires us to have our finger on the pulse of multiple teams within Yieldmo. We collaborate in real-time via Slack and our office setup makes it easy to swing by someone's desk. We also have recurring cross-functional stands ups as well bi-weekly All Hands company meetings.

Indu Narayan

VP Data

What makes someone successful on your team?

Success on my team belongs to the curious self-starter. The landscape is constantly changing and creative problem solving is a key skill when you rarely encounter the same issue twice. You have to love digging into the "why" and "how" of everything. Success on this team rises and falls on continuous learning and collaboration.

Dan Contento

SVP Growth & Automated Partnership

How do your team's ideas influence the company's direction?

I'm a huge believer in trying out new ideas and encouraging my team to stretch themselves. We have an award for when something goes wrong with an untested idea. It celebrates that we didn't let the fear of the unknown stop us from trying and 9 times out of 10 we learn something really important. We help solidify Yieldmo's true north.

Timothy Price

SVP, Sales and Accountability

What are Yieldmo Perks + Benefits

Culture
Friends outside of work
Eat lunch together
Daily stand up
Open door policy
Group brainstorming sessions
Open office floor plan
Diversity
Dedicated Diversity/Inclusion Staff
Highly diverse management team
Unconscious bias training
Health Insurance & Wellness Benefits
Dental Benefits
Vision Benefits
Health Insurance Benefits
Retirement & Stock Options Benefits
401(K)
Company Equity
Employee Stock Purchase Plan
Performance Bonus
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Vacation & Time Off Benefits
Generous PTO
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Free Daily Meals
Stocked Kitchen
Some Meals Provided
We provide free breakfast on Friday. Employees get free lunch on Monday, Tuesday, Wednesday, Thursday, Friday.
Happy Hours
Happy hours are hosted On occasion .
Pet Friendly
Professional Development Benefits
Job Training & Conferences
Lunch and learns
Cross functional training encouraged
Promote from within
More Jobs at Yieldmo12 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
Internships
Marketing
Sales
Developer
new
New York
Data + Analytics
new
New York
Sales
new
New York
Data + Analytics
new
New York
Sales
new
New York
Developer
new
New York
Design + UX
new
New York
Marketing
new
New York
Developer
new
New York
Developer
new
New York
Internships
new
New York