BigData Architect (Databricks + AWS) @ SoftServe v Česko
SoftServe
Na dálkuPráce odkudkoli
Česko
Odpovědnosti
Původní popisek.
Design and support implementation of scalable data solutions using Databricks on AWS
Develop and maintain batch and streaming data pipelines and Lakehouse architectures
Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans
Support data ingestion activities, including source-to-target mappings and integration of new data sources
Participate in architecture discussions and contribute to scaling the data platform and maintaining data models
Work with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflows
Ukázat vše (11)
O pozici / o projektu
Původní popisek. In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem. You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment
Odpovědnosti Původní popisek. - Projektowanie i rozwój bezpiecznych, skalowalnych i wysoko dostępnych rozwiązań chmurowych opartych na AWS. - Tworzenie i utrzymywanie architektur referencyjnych, standardów technicznych oraz dobrych praktyk w zakresie rozwiązań chmurowych. - Analiza wymagań biznesowych i technicznych klientów ...
... automation platforms such as env0, Spacelift, or similar - Serverless and event-driven architectures (Lambda, Step Functions, Kinesis, IoT Core). - Ansible. - AWS certifications (Solutions Architect, DevOps Engineer). - Energy systems, IoT or data-heavy platforms. - Data analytics platforms (e.g. Databricks, Snowflake or ...
... processing deduplication, and right-sizing Ukázat vše (9) O pozici / o projektu Původní popisek. About the Role We are looking for an experienced Data / Solution Architect to lead the design of a migration from a custom reporting platform to Databricks. The role combines architecture ownership with hands-on technical work and ...
... users. - Translate business requirements into data models, ETL/ELT processes, and technical specifications. - Design and develop scalable data pipelines using Databricks, PySpark, Azure, and SQL. - Build and optimize batch and near real-time data processing solutions. - Design and maintain Lakehouse architectures. Ukázat vše ...
Požadujeme * Komerční zkušenosti v oblasti DevOps nebo správy cloudové infrastruktury AWS včetně kontejnerových aplikací * Automatizace a infrastruktura - znalost Terraform, včetně tvorby vlastních modulů, správy stavu infrastruktury a úprav existujících konfigurací. * Zkušenost s automatizací v Python / Bash * Znalost ...
Požadujeme * Komerční zkušenosti v oblasti DevOps nebo správy cloudové infrastruktury AWS včetně kontejnerových aplikací * Automatizace a infrastruktura - znalost Terraform, včetně tvorby vlastních modulů, správy stavu infrastruktury a úprav existujících konfigurací. * Zkušenost s automatizací v Python / Bash * Znalost ...
... and collaboration - Strong project management and organizational skills Preferred Skills: - Proven experience with Data Lake / Datalakehouse implementations in AWS or Azure, using MS Azure (DataBricks, Data Factory, Data Lake, Cosmos DB, Event Hub, PowerBI, ..) or AWS (Glue, EC2, EMR, RDS, Redshift, Sagemaker, …) cloud services ...
... several interesting functionalities of the EMS. Apply to this DevOps / Cloud Platform Engineer to become the third member of DevOps team. One colleague owns the AWS architecture and security, the other keeps fleet of on-site edge controllers running with Ansible. You'll focus on the cloud side: working on the AWS infrastructure ...
... manufacturing facilities and commercial offices across multiple regions. Our client offers: - The chance to take an active role in a major cloud transformation and AWS migration initiative. - An opportunity to influence cloud architecture and technical standards across AWS and Azure environments. - Exposure to modern AI capabilities ...