MonkeyDB: Effectively Testing Correctness under Weak Isolation LevelsVirtual
Fri 22 Oct 2021 21:50 - 22:05 at Zurich B - Test and Verification - mirror Chair(s): Shigeru Chiba
Modern applications, such as social networking systems and e-commerce platforms are centered around using large-scale storage systems for storing and retrieving data. In the presence of concurrent accesses, these storage systems trade off isolation for performance. The weaker the isolation level, the more behaviors a storage system is allowed to exhibit and it is up to the developer to ensure that their application can tolerate those behaviors. However, these weak behaviors only occur rarely in practice and outside the control of the application, making it difficult for developers to test the robustness of their code against weak isolation levels.
This paper presents MonkeyDB, a mock storage system for testing storage-backed applications. MonkeyDB supports a key-value interface as well as SQL queries under multiple isolation levels. It uses a logical specification of the isolation level to compute, on a read operation, the set of all possible return values. MonkeyDB then returns a value randomly from this set. We show that MonkeyDB provides good coverage of weak behaviors, which is complete in the limit. We test a variety of applications for assertions that fail only under weak isolation. MonkeyDB is able to break each of those assertions in a small number of attempts.
Fri 22 OctDisplayed time zone: Central Time (US & Canada) change
13:50 - 15:10 | |||
13:50 15mTalk | MonkeyDB: Effectively Testing Correctness under Weak Isolation LevelsVirtual OOPSLA Ranadeep Biswas Informal Systems, Diptanshu Kakwani Microsoft, India, Jyothi Vedurada IIT Hyderabad, Constantin Enea University of Paris / IRIF / CNRS, Akash Lal Microsoft Research DOI | ||
14:05 15mTalk | Formal Verification of High-Level SynthesisVirtual OOPSLA Yann Herklotz Imperial College London, James D. Pollard Imperial College London, Nadesh Ramanathan Imperial College London, John Wickerson Imperial College London DOI Pre-print File Attached | ||
14:20 15mTalk | Specifying and Testing GPU Workgroup Progress ModelsIn-Person OOPSLA Tyler Sorensen University of California at Santa Cruz, Lucas Fernan Salvador Princeton University, Harmit Raval Princeton University, Hugues Evrard Google, John Wickerson Imperial College London, Margaret Martonosi Princeton University, Alastair F. Donaldson Imperial College London DOI | ||
14:35 35mLive Q&A | Discussion, Questions and Answers OOPSLA |
21:50 - 23:10 | |||
21:50 15mTalk | MonkeyDB: Effectively Testing Correctness under Weak Isolation LevelsVirtual OOPSLA Ranadeep Biswas Informal Systems, Diptanshu Kakwani Microsoft, India, Jyothi Vedurada IIT Hyderabad, Constantin Enea University of Paris / IRIF / CNRS, Akash Lal Microsoft Research DOI | ||
22:05 15mTalk | Formal Verification of High-Level SynthesisVirtual OOPSLA Yann Herklotz Imperial College London, James D. Pollard Imperial College London, Nadesh Ramanathan Imperial College London, John Wickerson Imperial College London DOI Pre-print File Attached | ||
22:20 15mTalk | Specifying and Testing GPU Workgroup Progress ModelsIn-Person OOPSLA Tyler Sorensen University of California at Santa Cruz, Lucas Fernan Salvador Princeton University, Harmit Raval Princeton University, Hugues Evrard Google, John Wickerson Imperial College London, Margaret Martonosi Princeton University, Alastair F. Donaldson Imperial College London DOI | ||
22:35 35mLive Q&A | Discussion, Questions and Answers OOPSLA |