Data Engineering Specialist

ABOUT THE OPPORTUNITY

The Knowledge Engineering Specialist, Media Viability Accelerator (MVA) will head up an necessary operate for a cutting-edge, on-line platform that can set a brand new commonplace for the trade — growing, testing, and deploying information elements for the MVA.

Reporting to the Media Enterprise Unit’s Head of Expertise, the Knowledge Engineering Specialist will oversee Azure Synapse, notebooks, pipelines, and associated assets. This position entails managing information pipelines, databases, and visualizations for the MVA, together with Energy BI embedded analytics. Moreover, the position includes implementing information scraping for enriched datasets and liaising with the Again-Finish Net Improvement Specialist.

ABOUT THE MVA

Solely by staying in enterprise can unbiased information and data suppliers preserve folks secure and in a position to make knowledgeable selections that have an effect on their lives. With the rise of digital media, social and leisure platforms, and disinformation, these unbiased media wrestle to outlive. To assist meet this problem, Internews has secured a 3-year program from USAID which will probably be generally known as the Media Viability Accelerator (“MVA”) Ahead. It is going to be a extremely seen initiative (introduced on the 2021 and 2023 Summits for Democracy) and will have substantial influence on the media sector worldwide.

MVA Ahead is contributing to the event of a brand new on-line platform supporting unbiased media in strengthening their enterprise efficiency. Construct on Azure and utilizing ASP.NET Core, Angular, and Bootstrap with embedded Energy BI information visualizations, the platform provides a rising array of tailor-made insights and alternatives that may remodel media companies. By making these alternatives intuitive and straightforward to behave on, unbiased media at scale will have interaction to create a thriving new ecosystem that unlocks new paths to long-term monetary safety.

Delivered to Minimal Viable Product in January 2024 after seven months of growth, the platform is now prepared for phased launch by way of public launch by August 2024. Over the approaching years, the event crew will add options, performance, and languages in order that unbiased media all over the world can use the platform. In collaboration with Microsoft, the combination of AI to create highly effective insights and suggestions is a precedence. To make sure deep understanding of the MVA’s material, goal, and datasets, a small and devoted crew will lead additional growth, supplemented by contractors for any particular deliverables past the crew’s capability.

LOGISTICS

Internews has Headquarters workplaces in Washington, DC and London, UK which assist a hybrid workforce with employees working remotely, totally in-office, or partially distant. This can be a remote-based position, and candidates primarily based wherever in the USA or United Kingdom will probably be thought of.

Purposes will probably be reviewed on a rolling foundation, so candidates are inspired to use quickly.

This can be a limited-term place with an anticipated finish date of September 24, 2026.

OUR COMMITMENT TO FOSTERING A CULTURE OF BELONGING

We’re a corporation of dynamic, mission-driven people who’re obsessed with our core values and about supporting optimistic change on the planet. We satisfaction ourselves on our dedication to innovation and adaptability. We imagine that numerous groups are robust groups and work to support an ethic of belonging, dignity, and justice for all people. Our present crew consists of a mixture of genders, dad and mom and non-parents, and other people of a number of races, nationalities, ages, sexual orientations, and socioeconomic backgrounds. We’re an EEO employer and encourage candidates of all races, genders, ages, orientations, ethnicities, and nationwide origins to use, and welcome these with different backgrounds and experiences.

DAY-TO-DAY TASKS will embody:

Common

• Dedication to understanding the MVA’s material, goal, datasets, and core applied sciences to make sure significant contribution to this system’s total targets.
• Contribute to defining the scope, targets, and actions of the MVA.
• In all duties, upholding Internews’ Core Values and demonstrating a dedication to fostering a tradition of Belonging, Dignity, and Justice.

Collaboration

• Collaborating with the MVA Ahead program crew, which leads the rollout of the platform globally, guaranteeing accomplice and stakeholder suggestions is mirrored within the MVA.
• Working carefully with colleagues to enhance utility usability and have integration.
• Working in Scrum and contributing to dash planning, objective setting, and product design.
• Speaking with, coordinating with, and/or managing the work of exterior contractors and options suppliers.

Knowledge Engineering

• Knowledge Pipelines: Preserve and prolong analytics pipelines and studies with Energy BI, Energy Question, Azure Knowledge Manufacturing unit, and Azure Synapse. Deal with integrating real-time information processing and automatic information high quality checks to assist dynamic enterprise wants.
• Database Methods: Construct and handle database programs for environment friendly indexing, querying, pre-fetching and caching with lively administration of Azure SQL and Synapse Analytics. Implement greatest practices for database versioning and schema administration to make sure system robustness and information integrity.
• Optimizing Efficiency: Optimize connectors, reminiscence administration, and queues for max accessibility, velocity, scalability, and future compatibility. Monitor and determine bottlenecks in Energy BI and information pipelines, with changes grounded in testing and consumer suggestions.
• Knowledge Storage: Handle, keep, and rotate encrypted information shops — together with information warehousing, transformation, staging, and high quality assurance. Make use of superior encryption strategies and catastrophe restoration methods to safeguard information.
• Automated Job Administration: Oversee scheduled duties for consumer registration and information scraping operations to take care of environment friendly information processing workflows.
• API Integration, Administration and Python Scripting: Develop and keep integrations with platforms comparable to Google Analytics, Meta, YouTube, MailChimp, WhatsApp, and Telegram for information retrieval and evaluation. Moreover, develop, enhance, and keep Python scripts for net scraping, extracting information on a scheduled foundation from public directories and user-specified sources comparable to accomplice net properties.
• Integration with Again Finish: Work carefully with the Again-Finish Net Improvement Specialist to make sure seamless collaboration to combine the data-gathering course of with backend providers.
• Knowledge Modeling: Contribute to the continued analysis of the MVA’s information fashions and studies.
• Documentation: Preserve and prolong documentation of processes and elements. Guarantee documentation is accessible and updated to assist crew collaboration and data sharing.
• Code Upkeep and Enchancment: Preserve and improve the present codebase for optimum efficiency and scalability, with a concentrate on future compatibility.
• Testing: Implement steady logging and testing methods. Undertake Take a look at-Pushed Improvement (TDD) or Conduct-Pushed Improvement (BDD) methodologies to make sure high-quality outputs and environment friendly bug monitoring.
• Actions and Automation: Guarantee the sleek scheduling and execution of pipeline duties. Handle cycles of updates, launch and deployment for elements. Observe and keep automated upkeep and atmosphere workflows.
• Venture Administration Instruments: Points and docs in Azure DevOps and Jira are key to challenge administration, monitoring duties, and collaborating with crew members.

QUALIFICATIONS WE’RE LOOKING FOR

Required

• A minimal of 10 years of prior related expertise, together with at the very least three years {of professional} expertise as a Knowledge Engineer, with a confirmed observe report of profitable initiatives.
• Microsoft Azure Knowledge Engineer certification, indicating in-depth data of Azure providers and greatest practices.
• Familiarity with Azure cloud providers together with ADLs, Azure Key Vault, and Azure Batch.
• Superior expertise or certifications in Azure cloud providers and options strongly most well-liked.
• Database and information warehousing experience, together with expertise with Azure SQL Database and Azure Synapse Analytics for information storage and warehousing.
• Capacity to put in writing and keep Python scripts for information scraping duties, highlighting versatility in programming language and frameworks.
• Integration expertise, together with OAuth authentication and dealing with RESTful APIs for information retrieval, manipulation, and third-party service integration.
• Proficiency with steady integration and steady deployment (CI/CD) practices and instruments, together with expertise in utilizing model management programs like Git, guaranteeing greatest practices in code administration and deployment workflows.
• Glorious written and spoken English abilities.
• Confirmed interpersonal abilities, together with glorious team-building and communication abilities.
• Expertise with agile software program growth in a crew.
• Capacity to work successfully each independently and in shut collaboration with colleagues, throughout a number of places.
• Demonstrated organizational abilities, capacity to multi-task and prioritize workload.
• Self-reliance, resourcefulness, flexibility, and problem-solving angle.
• Optimism, a humorousness, and pleasure relating to this work.

Most well-liked

Notice: Candidates who should not have the popular {qualifications} under, however who’re and keen to be taught, are inspired to use.

• Expertise working with efficiency metrics for information visualization.
• Capacity to troubleshoot complicated points and develop efficient options.
• Intensive expertise with greatest practices in information safety and compliance.
• Expertise working with information media.
• Proficiency in some other spoken language.