What is The Apache Software Foundation?
Introduction to the Apache Software Foundation
Many foundational data technologies, from Hadoop and Spark to Kafka and Iceberg, are open source. However, “Open Source” means more than putting code on GitHub. Projects need governance, legal protection, and a neutral home so that competing companies can collaborate on the same code with clear rules about ownership and licensing.
The Apache Software Foundation (ASF) describes itself as the world’s largest open source foundation. Founded in 1999, it provides organizational, legal, and financial support for hundreds of open source projects.
ASF projects are named “Apache” plus the project name (e.g., Apache Spark), and “Apache” is a trademark of the foundation.
The Apache Way
The ASF is known for its approach to building and managing open source software, called “The Apache Way.”
Three of its best-known elements are:
1. Collaborative Software Development
Project decisions are made in the open. Discussions, feature proposals, and votes happen on public mailing lists, summed up in the ASF saying “if it didn’t happen on the list, it didn’t happen.” Conversations elsewhere, such as a private chat channel, must be brought back to the list before decisions are made. This keeps the project transparent to its community.
2. Commercial-Friendly Standard License (The Apache 2.0 License)
This is one of the ASF’s most influential contributions to the tech industry. The Apache License 2.0 is permissive. It allows any business to take Apache code, modify it, embed it in its own proprietary software, and sell it, without releasing its own source code or paying royalties, as long as it keeps the required license and notice files. It also includes an explicit patent license from contributors. This commercial friendliness is a major reason cloud providers and software vendors build products on Apache projects.
3. Vendor Neutrality
An Apache project should not be controlled by a single company. For example, Apache Iceberg was created at Netflix and donated to the ASF in 2018. Today its committers and Project Management Committee (PMC) members work at many different companies. The ASF expects people to participate as individuals, not as representatives of their employers, so that the software serves the broader community rather than one company’s agenda.
The Apache Incubator
Most projects that join the ASF go through the Apache Incubator before becoming Top-Level Projects.
When a company (like Uber, who created Apache Hudi) wants to donate their code to the ASF, they enter the Incubator. During this phase, ASF mentors help the project’s developers learn “The Apache Way.” The project must show it can build a diverse community of contributors beyond the founding company, and it must clear intellectual property and licensing reviews so that the code can be released under the Apache License.
Once a project graduates from the Incubator, it becomes a Top-Level Project (TLP), signaling that the project has sound licensing, an independent community, and a working governance process.
Conclusion
The Apache Software Foundation is a central governance body for much of the open data ecosystem. Through its commitment to vendor neutrality and a clear legal framework, the ASF gives competing companies a neutral place to collaborate on the infrastructure that modern data platforms are built on.
Learn More
To learn more about the Data Lakehouse, read The Lakehouse Built for Everyone by Alex Merced. You can find this and other books by Alex Merced at books.alexmerced.com.