Senior Data Engineer

Posted Jan 24


Join the team as our next Staff Software Engineer, CDaX

About the job

Twilio is seeking a Staff Software Engineer for CDAX (Corporate Data Analytics & Infrastructure) team with industry experience and a deep understanding of data usage and life cycles across a SaaS-based organization. We are looking for someone to build the data processing and integration layer that extracts raw real time data from our internal platforms or 3rd party systems and stores/summarizes/presents it appropriately for analysis across multiple business teams for both tactical and strategic initiatives along with setting up and maintaining the infrastructure along the way.

Responsibilities

In this role, youll:

  • Build and launch real-time data processing pipelines supporting various insights projects
  • Build and launch real-time scalable 3rd party integration framework
  • Implement automated data quality framework ensuring highest standard of data accuracy
  • Design and scale our self service analytics platform supporting company wide initiatives
  • Work across multiple teams in high visibility roles and own the solution end-to-end.
  • Organize, and mine massive data sets of both structured and unstructured data by implementing appropriate infrastructure tools and systems to house data for reporting and analytics purposes.

Qualifications

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having desired qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table

Required:

  • 7+ years of diverse experience in building data processing frameworks and services
  • Experience working with distributed analytics platforms - Hive, Presto etc.
  • Experience working with real-time data processing technologies like Kafka, Spark streaming etc.
  • Experience with NoSQL database technologies like Cassandra, DynamoDB etc.
  • Experience building scalable services and related frameworks like Akka etc.
  • Experience with DAG based open source workflow management solutions airflow etc.
  • Expert coding skills across a number of languages including Scala, Java, Python etc.
  • Experience in processing various file formats such as Parquet, Avro, JSON etc

Location

This role will be remote or based in Denver, Co.

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Twilio thinks big. Do you

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now



Misc Info For This Position:

Remote Mix: 100% Remote

Position Level: Senior

Job Type: Full-Time

Regional Restrictions: USA Only


Apply for this Position


Share this job:

See more Data Jobs



Twilio


United States

Website


Job Info:
100% Remote
Senior
Full-Time
USA


Apply for this Position


See All Their Jobs



Share this job: