דרושים » פיתוח תוכנה » למחלקת הדאטה ב YNET דרוש.ה ראש צוות אנליזה ומחקר

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange and continue reaching new heights! Come work alongside Similarwebbers who are bright, curious, practical, and good people.

Were looking for a DATA -BACKEND (DATA EXTRACTION) to take an important part in SimilarWebs data extraction team and play a key role in our growing data acquisition operation.

This role will report to the Team manager- R&D.

Why is this role so important at Similarweb?

Similarweb is a data-focused company, and data is the heart of our business. As a data server engineer, you will work in one of the companys core teams and design and implement complex, high-scale systems that retrieve and analyze data from around the internet.

You will be responsible for:

Scraping - Building and maintaining high scale web-scraping operations.
Processing - Creating complex data pipelines that process and enrich our raw data and serve it to different consumers through various databases and data-lakes.
Engineering - Designing and building large scale, high quality systems to support our data infrastructure and production systems
As a Data-Server Engineer in Data Extraction, you will:

Write complex PySpark applications that process, manipulate and validate large datasets, in high quality and under strict SLA.
Develop dockerized high-performance microservices.
Take a major part in designing and implementing complex high scale systems using a large variety of technologies.
Work in a team with talented and independent engineers with whom youll be able to share knowledge and expertise.
learn new technologies, handle a multitude of systems.
Implement solutions in AWS cloud environment.
Take part in monitoring and debugging data pipelines and high scale services in order to identify and fix bottlenecks and failures.

As part of Lite Interfaces team, youll be part in creating and improving products used by more than 1 billion users around the world, as well as driving growth for Metas family of apps through platforms such as SEO and paid marketing.

Our data engineers work cross-functionally with software engineering, data science and product management to provide the team with essential data needed for making strategic decisions, finding opportunities and answering crucial questions about our users and products.

As a data engineer, you'll have the opportunity to work with petabyte scale datasets and complex data models and logics, which youll then translate into efficient and scalable pipelines, tables and dashboards.
Data Engineer, Lite-Interfaces Responsibilities
Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way
Design, build, and launch collections of sophisticated data models and visualizations that support multiple use cases across different products or domains
Solve challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources
Determine and implement the security model based on privacy requirements, confirm safeguards are followed, address data quality issues, and evolve governance processes within allocated areas of ownership
Optimize logging, pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts
Influence product and cross-functional teams to identify data opportunities to drive impact