DeathStarBench: An Open-Source End-to-End Microservices Benchmark Suite

Cloud services are undergoing a major shift from monolithic applications to graphs of many single-concerned and loosely-coupled microservices. Microservices facilitate and accelerate development and deployment, and allow software specialization, but they also introduce several hardware and software challenges. To study the implications microservices have, we have designed a set of end-to-end, representative applications using microservices that implement popular services, such as social networks, media services, and e-commerce sites.

Status (05/14/2019): The social network application is now available in the following repo. The remaining applications will also be available in the same repo shortly.

Faculty

Christina Delimitrou

Ph.D. Students

Yu Gan

Yanqi Zhang

Mingyu Liang

Zhuangzhuang Zhou

Nikita Lazarev

MS/Undergrad Students

Dailun Cheng

Ankitha Shetty

Priyal Rathi

Nayan Katarki

Ariana Bruno

Justin Hu

Brian Ritchken

Brendon Jackson

Kelvin Hu

Yuan He

Meghna Pancholi

Brett Clancy

Chris Colen

Fukang Wen

Catherine Leung

Siyuan Wang

Leon Zaruvinsky

Mateo Espinosa

Rick Lin

Zhongling Liu

To learn more about the applications in the benchmark suite, and the implications of microservices across the system stack, please take a look at the papers below.

• "Sage: Practical & Scalable ML-Driven Performance Debugging in Microservices". Yu Gan, Mingyu Liang, Sundar Dev, David Lo, and Christina Delimitrou. To appear in 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Detroit, MI, April 2021. [pdf] [slides] [bibtex]



• "Sinan: ML-Based & QoS-Aware Resource Management for Cloud Microservices". Yanqi Zhang, Weizhe Hua, Zhuangzhuang Zhou, Ed Suh, and Christina Delimitrou. To appear in 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Detroit, MI, April 2021. [pdf] [slides] [bibtex]



• "Dagger: Efficient and Fast RPCs in Cloud Microservices with Near-Memory Reconfigurable NICs". Nikita Lazarev, Shaojie Xiang, Neil Adit, Zhiru Zhang, and Christina Delimitrou. To appear in 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Detroit, MI, April 2021. [pdf] [slides] [bibtex]



• "Dagger: Towards Efficient RPCs in Cloud Microservices with Near-Memory Reconfigurable NICs". Nikita Lazarev, Neil Adit, Shaojie Xiang, Zhiru Zhang, and Christina Delimitrou. In Computer Architecture Letters (CAL), 2020. [pdf] [bibtex]



• "Sage: Leveraging ML To Diagnose Unpredictable Performance in Cloud Microservices". Yu Gan, Sundar Dev, David Lo, and Christina Delimitrou. In the Workshop on ML for Computer Architecture and Systems (MLArchSys), "Valencia, Spain", June 2020. [pdf] [slides] [bibtex]



• "Sinan: Data-Driven Resource Management for Interactive Microservices". Yanqi Zhang, Weizhe Hua, Zhuangzhuang Zhou, Ed Suh, and Christina Delimitrou. In the Workshop on ML for Computer Architecture and Systems (MLArchSys), "Valencia, Spain", June 2020. [pdf] [slides] [bibtex]



• "Unveiling the Hardware and Software Implications of Microservices in Cloud and Edge Systems". Yu Gan, Yanqi Zhang, Dailun Cheng, Ankitha Shetty, Priyal Rathi, Nayantara Katarki, Ariana Bruno, Justin Hu, Brian Ritchken, Brendon Jackson, Kelvin Hu, Meghna Pancholi, Brett Clancy, Chris Colen, Fukang Wen, Catherine Leung, Siyuan Wang, Leon Zaruvinsky, Mateo Espinosa, Yuan He, and Christina Delimitrou. In IEEE Micro Special Issue on Top Picks from the Computer Architecture Conferences, May/June 2020. [pdf] [bibtex]



• "Leveraging Deep Learning to Improve Performance Predictability in Cloud Microservices with Seer". Yu Gan, Yanqi Zhang, Kelvin Hu, Dailun Cheng, Yuan He, Meghna Pancholi, and Christina Delimitrou. In ACM SIGOPS Operating Systems Review, Vol. 53 Issue 1, July 2019. [pdf]
  Invited Paper



• "An Open-Source Benchmark Suite for Microservices and Their Hardware-Software Implications for Cloud and Edge Systems" Yu Gan, Yanqi Zhang, Dailun Cheng, Ankitha Shetty, Priyal Rathi, Nayantara Katarki, Ariana Bruno, Justin Hu, Brian Ritchken, Brendon Jackson, Kelvin Hu, Meghna Pancholi, Brett Clancy, Chris Colen, Fukang Wen, Catherine Leung, Siyuan Wang, Leon Zaruvinsky, Mateo Espinosa, Yuan He, and Christina Delimitrou. In Proc. of 24th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Providence, RI, April 2019.
  [pdf][bibtex]
  Selected in IEEE Micro's Top Picks special issue of "most significant papers in computer architecture based on novelty and long-term impact" for 2019



• "Seer: Leveraging Big Data to Navigate the Complexity of Performance Debugging in Cloud Microservices" Yu Gan, Yanqi Zhang, Kelvin Hu, Yuan He, Meghna Pancholi, Dailun Cheng, and Christina Delimitrou. In 24th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Providence, RI, April 2019.
  [pdf][demo][bibtex]
  Invited to SIGOPS Operating Systems Review



• "The Architectural Implications of Cloud Microservices" Yu Gan and Christina Delimitrou. In Computer Architecture Letters (CAL), vol. 17, issue 2, 2018.
  Selected as Best of CAL for 2018
  Received the Best Paper Award from the IEEE CS Publications Board for CAL 2018
  [pdf][bibtex]

An Open-Source Benchmark Suite for Microservices and Their Hardware-Software Implications for Cloud/Edge Systems [slides]

• ASPLOS'19, Providence, RI, April 2019.

The Hardware and Software Implications of Microservices and How Big Data Can Help [slides]

• Stanford University, Stanford, CA, October 2018.
• Google Platforms Seminar, Sunnyvale, CA, October 2018.

If you are interested in beta testing the benchmark suite, please reach out to us at: microservices-bench-L@list.cornell.edu