Find your next job at a growing startup

196
companies
3,050
Jobs

Sr. Data Engineer

Zylo

Zylo

Data Science
Indianapolis, IN, USA
Posted on Jan 12, 2025
Description

Zylo is the enterprise leader in SaaS Management, enabling companies to discover, manage, and optimize their SaaS applications. Zylo helps companies reduce costs and minimize risk by centralizing SaaS inventory, license, and renewal management. Trusted by industry leaders, Zylo’s AI-powered platform provides unmatched visibility into SaaS usage and spend. Powered by the industry’s most intelligent discovery engine, Zylo continuously uncovers hidden SaaS applications, giving companies greater control over their SaaS portfolio. With more than 30 million SaaS licenses and $34 billion in SaaS spend under management, Zylo delivers the deepest insights, backed by more data than any other provider.

Overview

Our Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data pipelines that efficiently collect, process, and store data for analysis. You will work closely with data scientists, analysts, and other stakeholders to ensure that the data infrastructure supports business intelligence, machine learning, and other data-driven solutions.

What will you do

  • Data Pipeline Development: Design, build, and maintain robust and scalable data pipelines to extract, transform, and load (ETL) data from various sources to data warehouses or data lakes.
  • Data Integration: Integrate data from multiple internal and external sources into centralized storage systems while ensuring data quality and consistency.
  • Database Management: Manage large datasets and databases, ensuring their security, performance, and scalability.
  • Data Modeling: Create and optimize data models to support analytics, reporting, and machine learning workloads.
  • Optimization and Performance: Continuously monitor and improve the performance, reliability, and efficiency of the data pipeline infrastructure.
  • Collaboration: Work closely with data scientists, business analysts, and other stakeholders to ensure data needs are met and best practices are followed.
  • Data Quality: Implement measures to maintain data integrity, cleanliness, and consistency across all systems.
  • Automation: Automate manual data tasks to streamline data workflows and reduce manual intervention.
  • Documentation: Document data processes, pipeline configurations, and data flow designs for team collaboration and future reference.
Requirements

What you will need:

  • Proven experience (5 years+) as a Data Engineer, Software Engineer with a data focus, Data Analyst, or similar role.
  • Strong knowledge of object-oriented design principles and methodologies.
  • Strong communication skills, both written and oral.
  • You’re a self starter who is excited about the fast pace of a growing, changing startup environment.
  • Experience
    • Strong knowledge of ETL processes, data pipelines, and data warehousing.
    • Hands-on experience with SQL, NoSQL, Hadoop, or Spark data stores.
    • Experience with AWS platform and technologies (EC2, S3, SageMaker, Athena, Glue, Bedrock)
    • Proficiency in programming languages like Python and SQL.
    • Experience with orchestration tools
  • Data Tools & Technologies:
    • Experience with data warehouses (e.g., Redshift, BigQuery, Snowflake).
    • Experience with Amazon S3 data lake.
    • Experience with streaming data (e.g., Kafka, Apache Flink).
    • Experience with ETL/ELT tools (Fivetran)
    • Experience with modeling tools and concepts (dbt, layer compartmentalization, etc)
    • Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker) is a plus.
    • Familiarity with data governance & security best practices (data retention, RBAC)
  • Soft Skills:
    • Strong problem-solving skills with attention to detail.
    • Excellent communication and collaboration skills.
    • Ability to manage multiple priorities in a fast-paced environment.
    • Self-driven, with the ability to work independently and within a team.

Nice to have

  • Experience in SaaS Management or Software Asset Management.
  • Experience with big data technologies and cloud platforms such as AWS, Azure, or Google Cloud.

What it’s like to work with us

At Zylo, we’re committed to Growing Stronger Together by fostering a diverse and inclusive workplace. We believe that a variety of perspectives not only fuels innovation, but also allows us to better serve our diverse customer base. If you meet the essential qualifications, we encourage you to apply and join us on this journey. Still growing in your career? Connect with our talent community—we’re always looking for future Zylos who share our passion for continuous learning.