Data Engineer

| New York

Build data-driven products and help us predict the next big thing.

At CB Insights, we build products to gauge and predict technology trends. This requires gathering information from disparate sources, analyzing it, extracting useful information and surfacing that on our platform. As a data engineer at CBI, you will be a core part of this process end-to-end and help us in building data pipelines and the infrastructure that enables this. You will help build products that use natural language processing and machine learning models and make them run efficiently with large amounts of data to enable the best user experience whether they be end-users or our data analysts.

We’re looking for engineers that, through hard-won practical experience, know how to build maintainable and testable data pipeline processes and infrastructure. We are looking for engineers that love solving problems and are willing to take on hard ones. Sounds a tad cliché but as engineers, we believe that the best professional satisfaction comes from knowing our customers use the software we’ve built and love it.

Key Responsibilities:

  • Engineer efficient, adaptable and scalable data pipelines that power our data products 
  • Design and build efficient ETL infrastructures for unstructured textual data sets and various other types of data sources 
  • Take a prototype of a data product built with NLP and/or machine learning models and make it run reliably in production.
  • Monitor and maintain existing data products running in production including identifying when models need to be retrained
  • Design and implement internal tools to make this data processing infrastructure easily accessible to and usable by other software developers
  • Develop solutions that are well-engineered, maintainable, tested and delivered on time.
  • Participate in code reviews and sprint planning, help to identify problems and share knowledge with your colleagues.

Required Experience and Qualifications:

  • 2+ years software/data engineering experience
  • 2+ years professional experience with using Python, SQL
  • Knowledgeable about data modeling, data storage techniques, data warehousing and general data architecture
  • Experience with engineering data pipelines to capture, store and process unstructured data
  • Experience with building and maintaining a Hadoop or Spark cluster and other related tools in the big data ecosystem
  • Excellent written and verbal communication skills
  • Excellent problem solving and analytical skills
  • Proficiency developing in a Mac/Linux environment
  • Technologies/Languages: Python, SQL, NoSQL, Spark, Hadoop

Additional Qualifications:

  • Experience with Go, Scala

Perks and Benefits:

  • Subsidized health, dental and vision insurance
  • 401K with up to 4% match
  • $1,000 yearly continuing education stipend
  • Daily lunch stipend

Equal Opportunity Employer: CB Insights is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

If you know someone who'd be perfect for the role, 
submit here and you'll be eligible for $5,000!

Read Full Job Description
Apply now
loading ...
Emailed

Technology we use

  • Engineering
    • GolangLanguages
    • JavascriptLanguages
    • PythonLanguages
    • ReactLibraries
    • ReduxLibraries
    • MySQLDatabases

Location

498 7th Avenue, 17th Floor, New York, NY 10018
498 7th Avenue, 17th Floor, New York, NY 10018

Insider's spotlight

What are some social events your company does?

There's a lot of fun events we do at CB Insights. Here's just a sample of things we've done in the past:
- company offsite
- holiday party
- monthly company-wide team building events (past events: bubble ball, game night, talent show, spelling bee, wine tasting, field day, bowling, etc.)
- New Hire Social
- CB Insights Jeopardy
- Manicures

Menaka Chang

Director of People Ops

Perks of working here

401(K) Matching
401(K)
Casual Dress
Commuter Benefits
Company Outings
Dental Benefits
Happy Hours
Health Benefits
Generous Parental Leave
Some Meals Provided
Stocked Kitchen
Vision Benefits
Volunteering Opportunities
More Jobs at CB Insights15 open jobs
All
Finance
Data + Analytics
Developer + Engineer
HR
Internships
Marketing
Project Mgmt
Sales
Content
Project Mgmt
new
CB Insights
Data + Analytics
new
CB Insights
Internships
new
CB Insights
Internships
new
CB Insights
Developer
new
CB Insights
Sales
new
CB Insights
Data + Analytics
new
CB Insights
Developer
new
CB Insights
Content
new
CB Insights
HR
new
CB Insights
Finance
new
CB Insights
Marketing
new
CB Insights
Marketing
new
CB Insights
Developer
new
CB Insights