Python & Apache Spark Engineer / Data Processing… - Jobeax
Popis nabídky
Python & Apache Spark Engineer / Data Processing Specialist @ Square One Resources v Česko
Square One Resources
Na dálkuPráce odkudkoli
Česko
Odpovědnosti
Původní popisek.
Software & Data Engineering
Design, develop, and maintain robust, scalable, and production-ready Apache Spark applications.
Develop efficient data processing, transformation, and analysis workflows using Python and Spark.
Build solutions capable of handling large-scale datasets while maintaining high performance and reliability.
Work with columnar data formats, particularly Parquet, and implement data solutions using Delta Tables.
Develop clean, maintainable, testable, and efficient code in accordance with established engineering standards.
Ukázat vše (21)
O pozici / o projektu
Původní popisek.
About the Project
You will join a dynamic technology team responsible for designing, developing, and deploying innovative enterprise technology and AI-driven solutions supporting the delivery of tax services.
The team combines expertise across software engineering, data engineering, AI, tax technology, change management, and project management . The projects cover the full technology lifecycle — from solution design and development through deployment and optimization, to training, adoption, and stakeholder engagement.
You will work in a modern, cloud-based environment and contribute to the development of scalable data processing solutions, with a strong focus on Python, Apache Spark, cloud technologies, microservices, and modern data platforms .
Technology Stack
Cloud: Microsoft Azure
Data Processing: Apache Spark, Databricks, Azure Synapse / Microsoft Fabric
... Strong fundamentals in data modeling, quality, orchestration, and lineage - Proficiency with Linux, shell scripting, SQL, and Python - Professional working proficiency in English - Collaborative mindset with open communication and shared responsibility - Experience with Docker, Kubernetes, or Apache Spark preferred []
... and Apache Spark / PySpark. - Migrating the existing data platform to Databricks (lakehouse), including rewriting legacy MS SQL Server stored procedures into Spark / Databricks SQL. - Building and maintaining a data service — a Python backend exposing data over a REST API, together with its web UI — from data model through ...
... zkušenosti s Databricks, Delta Lake a Spark; znalost Kafka, Flink nebo podobných frameworků je výhodou. o Zkušenosti s budováním datových kanálů pomocí nástrojů jako Apache Airflow, Data Factory nebo Apache Beam. o Znalost Terraformu, Pythonu a nástrojů CI/CD, jako jsou GitHub Actions. o Důkladná znalost správy dat, monitorování, ...
... engineering best practices. - Provide guidance and informal mentorship to junior team members. What We're Looking For - 5+ years of hands-on experience with Apache Spark, ideally on Databricks specifically. - Strong PySpark and SQL skills, including performance tuning of Spark jobs. - Practical experience with Delta Lake ...
... computing with Spark, and many more use cases. You will love it on the CPBU Manageability team if you: - want to understand how modern applications work with data and how we can make it better. - are ready to dive into a complex problem and be the one who will drive it to a resolution. - enjoy working with distributed systems, ...
... code review oraz stosowanie TDD i zasad clean code. O pozici / o projektu Původní popisek. Wspólnie z naszym Partnerem z branży e-commerce poszukujemy doświadczonego/ej specjalisty/ki do świadczenia usług jako Senior Software Engineer (Python) . Projekt dotyczy rozwoju wysokowydajnego silnika optymalizacji dostaw (Delivery ...
... Technologie: - PostgreSQL - SQL - Python - Apache Airflow - Sybase – současné databázové řešení v systému, relevantní zejména v kontextu migrace a přepisu sytému. ➕ Výhodou - zkušenost s migracemi databází - zkušenost s modernizací starších databázových řešení - zkušenost se Sybase - background z oblasti DWH, Data Engineeringu []
... professionals building infrastructure and software that supports the entire digital ecosystem. We are over 550 professionals and currently looking for a Software Python Engineer (GPU Cloud). Salary starting from 22 200 PLN gross/month , depending on experience, qualifications, and overall fit for the role. Benefits At Gcore, ...
... ceremonies O pozici / o projektu Původní popisek. Do you understand the power of persistence? Are you ready to get better every day? We're looking for a Senior Python Engineer to join our development team remotely. You’ll play a key role in building products that improve the experience of millions of Guidewire customers worldwide. ...
... the livelihoods of millions of coffee farmers around the world? Enveritas is a 501(c)(3) non-profit and Y Combinator-backed startup looking to hire for our Engineering & Data Group. We are looking for a backend software engineer with a focus on python and PostgreSQL to join our EUDR engineering team on a remote/global, ...