Energy-Efficient AI in the Data Center by Approximating DNNs for FPGAs
The goal of the eki project is to increase the energy efficiency of AI systems for deep neural network (DNN) inference through approximation techniques and mapping to high-end FPGA systems. DNNs have emerged in recent years as an essential approach to statistical machine learning. In the inference phase, classifications or regressions are computed on typically very large datasets, which already provides a significant computational load and associated CO2 emissions. As the demand for DNN inference will continue to grow strongly, there is a high need for action. FPGAs are a particularly well-suited technology for DNN inference because their hardware reconfigurability allows them to be optimally adapted to the application. In this project, based on the open source tool FINN, a software tooflow is developed that automates, optimizes and hardware-adapts DNNs. The approaches followed are the approximation techniques of network pruning and low precision quantization, as well as parallelization on an FPGA cluster. Subsequently, the achieved energy savings will be characterized by precise measurements in real server systems. Other aspects of the project include the development of an AutoML method for energy optimization and experimental evaluation using test DNNs and two use case studies from the areas of natural language processing and optimization in agriculture.
News
-
2024
- Oct 1, 2024 eki presented at FPL 2024 Oct 1, 2024
- Apr 19, 2024 Workshop: Efficient Neural Network Inference on FPGAs Apr 19, 2024
- Jan 21, 2024 eki presented at HiPEAC 2024 Jan 21, 2024
-
2023
- Dec 19, 2023 Workshop: Exploring Efficient Neural Network Inference on FPGAs with FINN Dec 19, 2023
- Sep 27, 2023 Marco Platzner at Deutschlandfunk Sep 27, 2023
- Sep 25, 2023 eki press release from Paderborn University Sep 25, 2023
- Sep 7, 2023 eki presented at FPL 2023 Sep 7, 2023
- Jul 18, 2023 Max Kuhmichel joined the eki team Jul 18, 2023
- Jul 18, 2023 Domenic Drechsel joined the eki team Jul 18, 2023
- Jul 2, 2023 Bjarne Wintermann joined the eki team Jul 2, 2023
- Jul 1, 2023 Qazi Arbab Ahmed joined the eki team Jul 1, 2023
- Jun 1, 2023 Linus Jungemann joined the eki team Jun 1, 2023
- Apr 19, 2023 Atousa Jafari joined the eki team Apr 19, 2023
- Mar 21, 2023 eki website is online Mar 21, 2023
- Feb 6, 2023 eki project kicked-off Feb 6, 2023
- Jan 1, 2023 Felix Jentzsch and Christoph Berganski form the core team to launch the project Jan 1, 2023
-
2022
- Nov 30, 2022 eki project proposal accepted Nov 30, 2022
- Nov 10, 2022 Paper on FINN published Nov 10, 2022