Senior Data Engineer

Job title:

Senior Data Engineer

Company

Index Exchange

Job description

We shaped the earliest forms of ad tech, and we’re looking for the technical expertise to help shape its future. Our customers have unique problems that can only be solved at internet scale, and that’s where the technical skills of our team make a real difference.Our exchange handles over 500 billion requests every day (for comparison Google serves an estimated 9 billion searches a day), all running in our own global data centers. Every member of our technology team has an enormous amount of autonomy in building and managing our systems to support and enable our growing level of scale. Through the transparency of our technology, dedication to innovation and integrity, and long-standing customer relationships, we lead through change.What’s it like to work at Index?We have more than 550 Indexers around the globe dedicated to building a safe and transparent marketplace that provides a trusted experience for consumers.Index is an exciting and fast-paced place to work. We’re built on our values of change, support, learning and teaching, trust, and intention. We pride ourselves on our independence and openness, not only in our technology, but in our teams, too. Our diverse and inclusive culture celebrates how we can leverage our unique differences to help drive Index forward.Our culture of success is truly supportive and collaborative. In working together across our teams, we’re continually investing in the people and technology to solve the industry’s most complex problems. As we extend the promise of ad tech to every channel, we’re looking for talented engineers to help advance Index, and the industry, forward.Are you ready to join the programmatic evolution?Index Exchange funds the open web. Content and journalism across the internet are funded through advertising, and we are the engine that helps to make that happen transparently, safely and efficiently. Handling hundreds of billions of auctions per day within milliseconds requires an intense understanding of the exchange and the ecosystem that we live in.Our business is growing significantly every year and is poised to grow even faster. Our people and our platforms are the foundation and enabler of that growth. We are significantly expanding our technology teams, and are looking for technologists with a passion for high performance software development, and a drive to deliver software products and platforms that enable and empower industries at a global scale.About The Role:We’re looking for a Senior Data Engineer to join our team and help build the next generation of big data solutions at Index Exchange with real-time streaming and batch analytical capabilities. Data is a big deal at Index Exchange (Index). Index’s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day. Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs.Working with exciting technologies, your team will experiment with new tools and engineer innovative approaches to solve interesting challenges. Things shift very quickly in our industry, and we rely on our Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction. We’re looking for Engineers who have experience in an Agile environment, who can drive innovation, and be a technical leader on our team.Index’s scale spans the globe, our transactions happen 24×7 in our global data centers, and every second that passes millions of requests are evaluated across our exchange. In order to achieve our mission, global efficiency and reliability are absolutely key, as every millisecond quite literally counts in our business.What We’re Looking For:

• Experience and Leadership: A senior engineer with exposure leading projects and mentoring junior developers. A leader who continuously challenges the status quo and brings forth innovative ideas and improvements for the team.
• Problem Solvers: You don’t stop until the problem gets solved and you find more than one way to solve it. You love working with other people, presenting your viewpoint but ultimately working towards the best solution, regardless of where it comes from
• Knowledge Hungry: Learning new frameworks and languages is exciting to you – you’re not satisfied with the status quo. We use a variety of languages and tools to solve problems and we’re interested in what you’re looking to learn.
• Passionate: You have a passion for Big Data and an interest in the latest trends and developments constantly researching new tools and data technologies

Here’s What You’ll be Doing:

• Evaluate new technologies, design, implement, and maintain data pipelines for extraction, transformation, and loading of data from a wide variety of data sources to various data services
• Identify, design, and implement system performance improvements
• Identify, design, and implement internal process improvements
• Automate manual processes and optimize data delivery
• Lead and mentor team members
• Identify and assess potential solutions for technical and business suitability

Here’s What You Need:

• Bachelor/ Master’s Degree in Computer Science or Engineering related fields
• 8+ years of experience as a Software Engineer in enterprise grade, large scale distributed software product development
• 5+ years of work experience designing and building high performance data pipelines and applications using Hadoop, Spark, Hive, Presto, Kafka and Flink streaming, Druid, or other similar technologies
• Proficiency in some of the following languages: SQL, Scala, Java, Python, Bash
• Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks
• Leadership, mentorship, collaboration, and communication skills
• Exposure to working and leading in a globally distributed, culturally diverse team
• Knowledge of data modeling, data warehousing, ETL processes, and business intelligence reporting tools
• Experience with SQL and NoSQL systems
• Experience with automated testing systems
• Experience working in Agile methodologies with continuous integration and delivery as CI/CD
• Experience working on and building distributed data pipelines that ingest and process large scale data and optimizations.
• Experience working with containerization, and virtualization tools such as Kubernetes, Docker
• Experience with integration of data from multiple data sources
• Experience with scheduling tools such as airflow, oozie

Why You’ll Love Working Here:

• Comprehensive health, dental, and vision plans for you and your dependents
• Paid time off, health days, and personal obligation days plus flexible work schedules
• Competitive retirement matching plans
• Equity packages
• Generous parental leave available to birthing, non-birthing, and adoptive parents
• Annual well-being allowance plus fitness discounts and group wellness activities
• Commuter benefits and discounts, where available
• Employee assistance program
• Mental health first aid program that provides an in-the-moment point of contact and reassurance
• One day of volunteer time off per year and a donation-matching program
• Bi-weekly town halls and regular community-led team events
• Multiple resources and programming to support continuous learning
• A workplace that supports a diverse, equitable, and inclusive environment –

NotificationIndex Exchange is aware that there have been recent scams directed toward candidates regarding job interviews and offers.Please be vigilant and do not accept interview requests, job offers, or other hiring-related documents from anyone other than our dedicated recruitment team, from the domain of @indexexchange.com. Our interview process consists of several steps, including phone screens and video interviews. We do not conduct interviews via an email questionnaire or request money at any point in the process.We remain dedicated to resolving this matter and we appreciate your support.Equal employment opportunityAt Index Exchange, we believe that successful products are built by teams just as diverse as the audience who uses them. As such, we are committed to equal employment opportunities. We celebrate diversity of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or veteran status. Additionally, we realize that diversity is deeper than any status or classification-diversity is the human experience. For those who show grit, passion, and humility-Index will welcome you.Accessibility for applicants with disabilitiesIndex Exchange welcomes and encourages individuals with disabilities to apply to work with us.If you require an accommodation, please share the details of your request and any information how we can assist you with the hiring recruiter when they contact you. Index Exchange will make reasonable efforts to ensure accommodation requests are met throughout the recruitment process.Index Everywhere, Index AnywhereOur corporate headquarters are in Toronto, with major offices in New York, Montreal, Kitchener, London, San Francisco, and many other global cities. As a major global advertising exchange, we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be.#LI-ONSIGHT#LI-HF1

Expected salary

Location

Toronto, ON

Job date

Sat, 31 Aug 2024 03:28:13 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (globalvacancies.org) you saw this job posting.