Experienced Back End Data Engineer
We are looking for a Back End oriented or Full Stack Engineer with a passion for complex data and building high quality software. In this role, you will work on essential tools to automate and manage data pipelines that powers Gartner for Marketers analytics and machine learning teams. As a member of our team you will enter a startup like fast-paced, challenging environment with the potential to make a large impact on our architecture and the organization. You will work on a wide variety of applications and data pipelines, and it is a great opportunity to grow.
Here is a sample of projects you would be contributing to:
A scalable internal platform that powers scraping of half a million pages a day.
Processing pipelines that ingest and process data from our data partners.
Integrating machine learning models into data pipelines.
A workflow application that automates data collection by humans.
What we’d like to see in you:
2 to 4 years of professional experience using Python to develop production-ready software.
Strong SQL knowledge and experience designing data models to solve a problem.
Experience with AWS in production settings.
Passion for learning and self-improvement, being receptive to feedback.
Comfortable with complexity and drive to make things simpler.
Ability to quickly learn a new vendor API, new tool or a technology concept.
Experience with modern web and application development practices: continuous integration, scrum or agile development, distributed version control systems, test-driven development, automated deployment and provisioning.
Ability to support product team on planning, scope breakdown, task estimation.
Strong communication skills, ability to self-motivate and self-direct.
Hands on with an active Github, Bitbucket or StackOverflow profile.
We believe in tackling difficult questions/problems as a team in order to get to the best solution and we don’t hesitate to change our approach when a better idea is on the table.
We are a cross-functional team of engineers (front-end, back-end, QA, and data), product managers, and data scientists. We practice code reviews, unit and integration testing, continuous integration and delivery, agile 2 week sprints, and take pride in seeing our work through from conception to deployment and to the next better iteration.
Primary data stores include S3, Postgres, Redshift, Athena, Snowflake, SQL is our lingua franca.
AWS (EC2, Lambda, EKS, Kinesis, Fargate, Cloudwatch, DynamoDB, etc).
Docker and Kubernetes deployments triggered by GitLab CI.
Airflow for workflow management.
dbt and more for ETL and data pipelines.
Job Requisition ID:35068
By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.
Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy
For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.