BigData Architect (Databricks + AWS) @ SoftServe v Česko
SoftServe
Na dálkuPráce odkudkoli
Česko
Odpovědnosti
Původní popisek.
Design and support implementation of scalable data solutions using Databricks on AWS
Develop and maintain batch and streaming data pipelines and Lakehouse architectures
Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans
Support data ingestion activities, including source-to-target mappings and integration of new data sources
Participate in architecture discussions and contribute to scaling the data platform and maintaining data models
Work with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflows
Ukázat vše (11)
O pozici / o projektu
Původní popisek. In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem. You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment
Odpovědnosti Původní popisek. - Projektowaniem i rozwojem architektury platformy Databricks w środowisku AWS. - Definiowaniem struktury workspace'ów i separacji środowisk DEV/TEST/PROD. - Projektowaniem rozwiązań sieciowych, bezpieczeństwa oraz zarządzania dostępem. - Rozwojem Unity Catalog, w tym zarządzaniem uprawnieniami, ...
Odpovědnosti Původní popisek. - Design and implement scalable cloud-based Data & Analytics architectures. - Translate business requirements into effective technical solutions. - Work with Databricks and Azure or AWS data services. - Support cloud infrastructure automation and CI/CD processes. - Collaborate with international ...
Odpovědnosti Původní popisek. - Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster. - Architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability. - Lead the development ...
DATABRICKS DATA ENGINEER Jsme Microsoft Data Platform Competence Center, přední odborníci na Microsoft datové technologie. Máme reálné zkušenosti se všemi trendy datových technologií, jako je Azure Data Factory, Microsoft Fabric, Databricks, Power BI, Purview, SQL Database, Palantir, Oracle a další. Neustále se učíme nové ...
... practices. Responsibilities: - Design, develop, and maintain scalable data pipelines and data solutions. - Build and optimize data processing workflows using AWS services. - Develop data transformations and processing solutions using Python, Java, SQL, and PySpark. - Work with Databricks and Dataiku to support data engineering ...
... processing deduplication, and right-sizing Ukázat vše (9) O pozici / o projektu Původní popisek. About the Role We are looking for an experienced Data / Solution Architect to lead the design of a migration from a custom reporting platform to Databricks. The role combines architecture ownership with hands-on technical work and ...
... users. - Translate business requirements into data models, ETL/ELT processes, and technical specifications. - Design and develop scalable data pipelines using Databricks, PySpark, Azure, and SQL. - Build and optimize batch and near real-time data processing solutions. - Design and maintain Lakehouse architectures. Ukázat vše ...
... skripty pro automatizaci procesů. - Nasazovat aplikace a kontejnery (Docker) do AWS (EC2, Lambda, ECS/EKS) - Konfigurovat IAM, bezpečnostní politiky a dodržovat AWS security best practices Požadujeme - 5+ let praxe jako Cloud nebo Infrastructure Engineer se znalostí prostředí AWS - Zkušenost s GitLab CI/CD. - Praktická zkušenost ...
... skripty pro automatizaci procesů. - Nasazovat aplikace a kontejnery (Docker) do AWS (EC2, Lambda, ECS/EKS) - Konfigurovat IAM, bezpečnostní politiky a dodržovat AWS security best practices Požadujeme - 5+ let praxe jako Cloud nebo Infrastructure Engineer se znalostí prostředí AWS - Zkušenost s GitLab CI/CD. - Praktická zkušenost ...
Odpovědnosti Původní popisek. - Design and evolve enterprise data architecture and cloud-based data platforms. - Define architecture for Data Lakes, data processing and analytics solutions on AWS. - Design scalable data ingestion, transformation, integration and processing pipelines. - Define architectural standards, patterns ...