AI & Data

PySpark Training

PySpark is a library for Apache Spark that enables the creation and execution of distributed tasks on clusters using Python.

Duration
6h
Ask about the program → See all
Who it's for

Ideal for teams that…

1 Developers with knowledge of Python
2 Individuals who want to learn one of the most popular tools for data processing
3 Data analysts with Python experience
4 Data scientists
Outcomes after the program

Hands-on AI and data analytics workshops — built around your team's real cases.

✓

Understand the application of Big Data in organizations

✓

Learn fundamental concepts related to working with data in Apache Spark

✓

Master Spark Project Core and Spark SQL

✓

Apply Spark ML in practical scenarios

Program · 12 modules

What we actually do

M01
Module 1 – Apache Spark Architecture
  • · Understanding Spark components and their roles
  • · Positioning Apache Spark within the Big Data landscape
M02
Module 2 – RDDs (Resilient Distributed Datasets)
  • · Core concept for distributed data processing in Apache Spark
M03
Module 3 – Differences Between Python Syntax and PySpark
  • · Comparing RDDs and Pandas DataFrames
M04
Module 4 – Variables, Partitioning, and Core Spark Concepts
  • · Deep dive into Spark’s foundational elements
M05
Module 5 – Spark SQL
  • · Working with DataFrames
  • · Syntax, schemas, and aggregations
M06
Module 6 – Spark ML (Machine Learning)
  • · Introduction to machine learning capabilities in Spark
M07
Module 7 – Prototyping
  • · Developing and testing data processing workflows
M08
Module 8 – Running and Managing Jobs on a Cluster
  • · Best practices for job execution and cluster management
M09
Module 9 – Testing Processes
  • · Ensuring reliability and correctness of data pipelines
M10
Module 10 – Optimization and Task Configuration
  • · Techniques for improving performance and resource utilization
M11
Module 11 – Spark Structured Streaming
  • · Handling real-time data streams with Apache Spark
M12
Module 12 – Q&A Session
  • · Addressing participant questions and clarifications
Every module is adapted to your stack and context. The above is a starting point — not a fixed agenda.
How we work

From brief to retro in 30 days.

01

Brief & diagnosis

A call with the team lead + a short survey for participants. We define goals, gap and context.

02

Program customization

We adapt modules, case studies and code examples to your stack. Approval in 5 days.

03

Workshop

Trainer-led sessions, hands-on, code review. Mentor available between sessions too.

04

Retro + report

Outcome report for the team and lead. 30 days of consulting included.

Inquiry

Send a brief. We'll reply within 1 day.

After a short brief we'll prepare a program and a quote. No obligations — it's just a starting point.

✓Quote within 48h of the brief
✓First session within 30 days
✓Pilot before the full decision
✓VAT invoice, payment in instalments possible

Ochrona antyspamowa (Cloudflare Turnstile) zostanie aktywowana po wpięciu klucza.

Other programs for teams

See all →
AI & Data

Active Directory Training

Hands-on AI and data analytics workshops — built around your team's real cases.

AI & Data →
AI & Data

Advanced Power BI Training

Hands-on AI and data analytics workshops — built around your team's real cases.

AI & Data →
AI & Data

Advanced RPA Developer Training

Hands-on AI and data analytics workshops — built around your team's real cases.

AI & Data →