Sr Data Engineer
Who you are:
You are detail oriented with a curious nature. You have
experience in working to find trends in data sets and developing
algorithms to help make raw data more useful. You have strong
communication skills and understand the purpose behind the work
that you do. You have experience with multiple programming
languages and over 5 years of experience with data engineering as
Senior level staff.
Ownership of data products, pipelines, and stakeholder
integrations is our bread and butter and this thrills you! With
your background in optimizing data retrieval and how to develop the
outputs needed for stakeholders - reports, dashboards, or other
visualizations. You are excited to build with us!
What you'll do:
The typical Data Engineer's role at Spiceworks Ziff Davis is
both fluid and challenging. You will work to run data through
pipelines and augmentations and data science technology in order to
score the leads and interest levels across multiple categories of
interest. Each day, you will build small, reusable components in a
large landscape of data, you'll collaborate with business teams to
improve data models that feed our business intelligence tools and
increase data accessibility, write integration tests, and
contribute to the internal engineering documents..
You'll have nuanced relationships across teams and you'll be a
critical point of contact for the Data Engineering function. In
this role, you will work across a data landscape with diverse
technologies and potentially work in situations that are not
clearly defined - as some tools do not have owners and you will
need to go into the system that you've never coded in before, but
you'll be responsible for diagnosing issues and identifying
You will have the standard ELT (Extract, Load, Transform)
responsibilities but as this is a Senior-level role, you'll also be
responsible for spearheading initiatives with other teams - ranging
from assisting Data Science in developing and deploying
microservices to be utilized to augment data to debugging a
fluctuation in data being produced by intermediate proxy
You will be in close contact with teams across the business and
will serve as a reliable, seasoned Engineering team member.
What will be your responsibilities?
- Design, coordinate, and implement data integrations between
other teams in the forms of databases, file payloads, microservices
- using the appropriate technology for the use-case (SNS, S3,
AuroraDB, K8s Background Job, etc)
- Design, implement and maintain data pipelines for both loading
disparate system's data into a Data Warehouse, as well as building
out data products.
What does it take to do this job?
- Experience working alongside Data Scientists to make use of the
data that they collect
- In-depth knowledge of distributed systems and computer
- A background in our primary technologies: AWS Components,
Kubernetes, Docker, Snowflake (ANSI-SQL), Python, Matillion (Data
Flow Orchestration), Data Dog
- Familiarity with technologies and languages like
- Demonstrated expertise with SQL (T-SQL and/or ANSI-SQL)
- Expertise with some modern programming languages (Python, Ruby,
- High comfort level with Docker
Spiceworks Ziff Davis is a safe, inclusive workplace for people
of all backgrounds and walks of life. We strongly encourage you to
apply if you are from a marginalized or underrepresented group,
particularly in the technology industry. Some candidates may see a
long list of job requirements and feel discouraged because they
don't match every single bullet point - we suggest, please apply
Work from Anywhere:
We're flexible on location wherever possible - we are a Work
From Anywhere company. We don't believe in a "perfect" candidate
because we believe in our core value, "Evolve and Adapt Quickly".
If you believe this is a role that you'll be excited to work in
every day, want to be a part of a culture like ours, and will be
relentless about pushing boundaries to succeed, please apply.
Who we are: Spiceworks Ziff Davis (SWZD) is a trusted global
marketplace that connects technology buyers and sellers with the
most actionable and precise intent data. We are uniquely positioned
to offer tech brands unmatched visibility into accounts that are
truly in-market, by leveraging our scale, quality and diversity of
intent data. With unparalleled access to the world's most
influential technology buyers through a combination of first-party
(Community, Tools, Editorial) and third-party intent data, SWZD is
a leader in intent-backed, intelligent, omnichannel marketing.
About SWZD | Open Job Opportunities | The 2021 State Of IT