Python & Apache Spark Engineer / Data Processing Specialist @ Square One Resources v Česko
Square One Resources
Česko
Odpovědnosti
Původní popisek.
Software & Data Engineering
Design, develop, and maintain robust, scalable, and production-ready Apache Spark applications.
Develop efficient data processing, transformation, and analysis workflows using Python and Spark.
Build solutions capable of handling large-scale datasets while maintaining high performance and reliability.
Work with columnar data formats, particularly Parquet, and implement data solutions using Delta Tables.
Develop clean, maintainable, testable, and efficient code in accordance with established engineering standards.
Ukázat vše (21)
O pozici / o projektu
Původní popisek.
About the Project
You will join a dynamic technology team responsible for designing, developing, and deploying innovative enterprise technology and AI-driven solutions supporting the delivery of tax services.
The team combines expertise across software engineering, data engineering, AI, tax technology, change management, and project management . The projects cover the full technology lifecycle — from solution design and development through deployment and optimization, to training, adoption, and stakeholder engagement.
You will work in a modern, cloud-based environment and contribute to the development of scalable data processing solutions, with a strong focus on Python, Apache Spark, cloud technologies, microservices, and modern data platforms .
Technology Stack
Cloud: Microsoft Azure
Data Processing: Apache Spark, Databricks, Azure Synapse / Microsoft Fabric
... zkušenosti s Databricks, Delta Lake a Spark; znalost Kafka, Flink nebo podobných frameworků je výhodou. o Zkušenosti s budováním datových kanálů pomocí nástrojů jako Apache Airflow, Data Factory nebo Apache Beam. o Znalost Terraformu, Pythonu a nástrojů CI/CD, jako jsou GitHub Actions. o Důkladná znalost správy dat, monitorování, ...
... and Apache Spark / PySpark. - Migrating the existing data platform to Databricks (lakehouse), including rewriting legacy MS SQL Server stored procedures into Spark / Databricks SQL. - Building and maintaining a data service — a Python backend exposing data over a REST API, together with its web UI — from data model through ...
... engineering best practices. - Provide guidance and informal mentorship to junior team members. What We're Looking For - 5+ years of hands-on experience with Apache Spark, ideally on Databricks specifically. - Strong PySpark and SQL skills, including performance tuning of Spark jobs. - Practical experience with Delta Lake ...
... computing with Spark, and many more use cases. You will love it on the CPBU Manageability team if you: - want to understand how modern applications work with data and how we can make it better. - are ready to dive into a complex problem and be the one who will drive it to a resolution. - enjoy working with distributed systems, ...
... Technologie: - PostgreSQL - SQL - Python - Apache Airflow - Sybase – současné databázové řešení v systému, relevantní zejména v kontextu migrace a přepisu sytému. ➕ Výhodou - zkušenost s migracemi databází - zkušenost s modernizací starších databázových řešení - zkušenost se Sybase - background z oblasti DWH, Data Engineeringu []
... the livelihoods of millions of coffee farmers around the world? Enveritas is a 501(c)(3) non-profit and Y Combinator-backed startup looking to hire for our Engineering & Data Group. We are looking for a backend software engineer with a focus on python and PostgreSQL to join our EUDR engineering team on a remote/global, ...
... Prague office in compliance with Everpure's policies, unless you are on PTO, or work travel, or other approved leave. WHAT YOU BRING - Solid basis in software engineering foundation building and maintaining backend or system‑level components in production. - Strong programming skills in C++ or Python and a willingness to pick ...
... Mindbox we connect top IT talents with technology projects for leading enterprises across Europe. Our client's looking for an experienced Software Security Engineer to help us design and deliver secure, cloud-native platforms and improve engineering resilience. You will work across application architecture, infrastructure, ...
... digital content creation - Take significant ownership over technical decisions and end-to-end feature delivery - Work in a fast-paced startup environment where engineering decisions have a direct impact on the product - Use modern technologies including Python, React, AWS, and AI development tools - Contribute to building scalable ...
Our stack: Python 3.12 (asyncio, FastAPI, Django), Docker, PostgreSQL, GitLab, Apache Avro, Kubernetes, AWS, RabbitMQ, C/C++/Rust We're Quantlane , a proprietary trading firm built for traders. Our goal is to create a best-in-class ecosystem that helps traders unlock their full potential. At the heart of it is our own trading ...