Design the migration from the existing custom reporting platform to Databricks
Define migration sequencing, regression testing, and rollback approaches
Ensure migration is delivered with no functional regression compared with current reporting outputs
Design the architecture for acquiring and processing external data
Define approaches for crawl reliability, rate governance, and compliance with source terms of use
Optimize LLM-related costs, model selection, processing deduplication, and right-sizing
Ukázat vše (9)
O pozici / o projektu
Původní popisek.
About the Role
We are looking for an experienced Data / Solution Architect to lead the design of a migration from a custom reporting platform to Databricks. The role combines architecture ownership with hands-on technical work and close collaboration with the client.
During the initial phase, you will define the migration approach, including tool inventory, sequencing, regression strategy, and rollback planning, as well as develop an external data strategy with a clear build-versus-buy recommendation.
... Design and support implementation of scalable data solutions using Databricks on AWS - Develop and maintain batch and streaming data pipelines and Lakehouse architectures - Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans - Support data ingestion activities, ...
... Bachelor’s or Master’s Degree in a technology-related field (e.g. Engineering, Computer Science, IT, etc.) - 3+ years experience in design and build of data solutions, a combination of relevant areas: - CRM data modelling - Large-scale Data Lake / Datawarehouse (DWH) solutions - Big data pipelines / ETL / APIs (data ingestion, ...
... Qualifications: - Bachelor’s or Master’s Degree in a technology-related field (e.g. Engineering, Computer Science, IT, etc.) - 3+ years experience in design and build of data solutions, a combination of relevant areas: - Large-scale Data Lake / Datawarehouse (DWH) solutions - Big data pipelines / ETL / APIs (data ingestion, processing, ...
... oriented solutions, incl. awareness of MLOps practices - GenAI and AI-ready data foundations (e.g. RAG, vector search, metadata and semantic layer) - Understanding data concepts and patterns, such as data mesh, data lake, master data management, data governance, data quality, batch and real-time/streaming architectures - Solid ...
... with data scientists and analysts to develop data solutions. - Monitor and troubleshoot data workflows to ensure reliability and efficiency. - Integrate with data sources and ensure proper data ingestion and transformation. - Research emerging big data technologies to improve the architecture. O pozici / o projektu Původní ...
... Azure, Google Cloud) - Architect and integrate popular open source software such as PostgreSQL, MongoDB, Kafka, Cassandra and NGINX - Help partners to offer and architect joint solutions utilizing Canonical’s technologies on top of the public clouds and in the data center - Design and publish joint Reference Architectures and ...
... security, compliance, and scalability standards while delivering clear business ROI. O pozici / o projektu Původní popisek. We are looking for a versatile AI Solutions Architect & Field Engineer to serve as the key technical bridge between our core product development and client operations. In this role, you will embed directly ...
... evolving Lakehouse on Azure, leveraging: - Databricks Data Factory Data Lake Storage Event Hub … and more cutting-edge technologies. - Develop sustainable architectures, prototype solutions, and evaluate new technologies to drive innovation. - Support engineering teams in platform architecture development and coach them ...
Odpovědnosti Původní popisek. - Contribute to architectural design and provide guidance on data-related solutions. - Take ownership of the entire domain, evaluating proposed solutions and technical decisions. - Oversee data-related requests and requirements, ensuring data consistency and quality. - Collaborate with multiple ...