The PAMCET Learning Team is the institutional curriculum and content group behind course publishing on this platform. PAMCET (Professional and Academic Management Centre for Education and Training) is operated by Digitpen Hub Ltd, a company registered in Lagos, Nigeria. Courses credited to the PAMCET Learning Team are structured, organized, and published centrally by the platform rather than authored by a single named individual instructor — each course's syllabus, learning outcomes, and content are reviewed before publication under this institutional account. For questions about a specific course or to report a content issue, please use the platform's Help & Support or Contact Us pages.
B.Eng DegreeFaculty of Faculty of Engineering & TechnologySoftware Engineering
SWE 310: Data Engineering & Scalable Data Pipelines
Architectural principles of large-scale data engineering. Batch vs stream processing, Extract-Transform-Load (ETL) and ELT pipelines, distributed compute frameworks (Apache Spark), distributed messaging, data lakehouse architectures (Apache Parquet, ...
Course Overview
Architectural principles of large-scale data engineering. Batch vs stream processing, Extract-Transform-Load (ETL) and ELT pipelines, distributed compute frameworks (Apache Spark), distributed messaging, data lakehouse architectures (Apache Parquet, ... Curriculum Structure &...
What You'll Learn
- Architect resilient, fault-tolerant batch and streaming data pipelines processing high-volume event streams.
- Write distributed dataset transformations using Apache Spark DataFrames and PySpark.
- Orchestrate multi-stage data dependencies using Apache Airflow Directed Acyclic Graphs (DAGs).
- Manage evolving data schemas using Apache Avro and Schema Registry without breaking consumers.
- Implement automated data quality verification gates using Great Expectations.
Requirements
- SWE 205
- SWE 210
Degree Programme Curriculum Context
This course is a curriculum unit of the Bachelor of Engineering (B.Eng.) in Software Engineering degree framework in Nigeria.
Earn Your Certificate
Showcase your skills with a certificate! Complete the course, submit your project, and earn your certificate. Here's a sample of what you'll receive to show off your accomplishments.
Course Curriculum
Open-access academic curriculum. All foundational lectures available to read free.
8 Chapters
•0 Lecture
•0s
No curriculum found.
Academic Ecosystem & Connected Pathways
Deepen your studies across connected learning pathways in the PAMCET academic network:
Digital Research Library16,000+ open-access monographs & textbooks
Structured Learning PathsCurated multi-course career specializations
WAEC / SSCE Examination HubComplete secondary school syllabus & mock tests
JAMB / UTME PreparationComputer-based tests & scoring analytics
Tertiary & University Hub100L - 400L degree benchmark modules
Credential Verification PortalInstant cryptographic certificate authentication
Instructor
PAMCET Learning Team
Institutional Course Curation · PAMCET
Qualifications:
PAMCET Learning Team — Institutional Course Curation, Digitpen Hub LtdMy Skills:
- Curriculum Curation
- Course Content Review
- Learning Outcome Design
- Course Publishing & Quality Assurance
- Platform Content Operations
Reviews
No reviews available
Free
Course Includes
8 Chapters
0 Lectures
1 week
Skill Level intermediate
Taught in English
Lifetime Access
Certification of Completion
Category: University - Software Engineering
Share On
Download Syllabus & Study Guide
Receive the full lecture syllabus, reading list, and milestone schedule for SWE 310: Data Engineering & Scalable Data Pipelines.
By submitting, you agree to receive educational updates. You can unsubscribe anytime. Read our Privacy Policy.