RQ1: How effectively do LLM-based APR tools perform on established benchmarks? Specifically, how closely do these bug fixes align with the ground-truth fixes provided by developers?
Repair Effectiveness on Defects4J and GitBug-Java: Table 2. (Supplement results not presented in paper)
Here are the specific bugs for each setting on the dataset Defects4J. Specifically, bugs with large search space and small search space are as follows.
Bugs-Large: "Chart-10", "Chart-13", "Chart-17", "Chart-3", "Chart-6", "Chart-8", "Chart-9", "Closure-1", "Closure-10", "Closure-104", "Closure-107", "Closure-109", "Closure-111", "Closure-113", "Closure-114", "Closure-118", "Closure-119", "Closure-12", "Closure-120", "Closure-122", "Closure-124", "Closure-125", "Closure-126", "Closure-129", "Closure-130", "Closure-132", "Closure-133", "Closure-14", "Closure-146", "Closure-15", "Closure-150", "Closure-152", "Closure-159", "Closure-161", "Closure-166", "Closure-19", "Closure-20", "Closure-33", "Closure-35", "Closure-36", "Closure-38", "Closure-5", "Closure-52", "Closure-55", "Closure-56", "Closure-57", "Closure-59", "Closure-61", "Closure-66", "Closure-67", "Closure-69", "Closure-71", "Closure-81", "Closure-82", "Closure-83", "Closure-91", "Closure-97", "Lang-11", "Lang-14", "Lang-16", "Lang-22", "Lang-26", "Lang-28", "Lang-33", "Lang-37", "Lang-38", "Lang-39", "Lang-40", "Lang-44", "Lang-45", "Lang-49", "Lang-52", "Lang-54", "Lang-55", "Lang-57", "Lang-58", "Lang-61", "Lang-9", "Math-10", "Math-101", "Math-105", "Math-17", "Math-19", "Math-20", "Math-27", "Math-3", "Math-32", "Math-33", "Math-34", "Math-39", "Math-45", "Math-48", "Math-5", "Math-50", "Math-53", "Math-56", "Math-63", "Math-73", "Math-75", "Math-89", "Math-9", "Math-91", "Math-96", "Mockito-1", "Mockito-12", "Mockito-18", "Mockito-22", "Mockito-24", "Mockito-27", "Mockito-28", "Mockito-29", "Mockito-33", "Mockito-38", "Mockito-5", "Mockito-7", "Mockito-8", "Time-14", "Time-15", "Time-16", "Time-24", "Time-25"
Bugs-Small: "Chart-1", "Chart-11", "Chart-12", "Chart-20", "Chart-24", "Closure-11", "Closure-123", "Closure-168", "Closure-18", "Closure-31", "Closure-62", "Closure-65", "Closure-70", "Closure-73", "Closure-77", "Closure-86", "Closure-92", "Lang-21", "Lang-24", "Lang-29", "Lang-43", "Lang-51", "Lang-59", "Lang-6", "Math-11", "Math-2", "Math-30", "Math-41", "Math-57", "Math-58", "Math-59", "Math-69", "Math-70", "Math-80", "Math-82", "Math-85", "Math-94", "Mockito-34", "Time-19", "Time-4"
GPT-3.5-ChatRepair-0
Plausible: 'Chart-1', 'Chart-11', 'Chart-20', 'Closure-11', 'Closure-126', 'Closure-52', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-77', 'Lang-21', 'Lang-29', 'Lang-33', 'Lang-39', 'Lang-52', 'Math-32', 'Math-41', 'Math-5', 'Math-50', 'Math-53', 'Math-57', 'Math-85', 'Math-91', 'Mockito-18', 'Mockito-24', 'Mockito-29'
Correct: 'Math-50', 'Chart-20', 'Lang-21', 'Lang-29', 'Closure-61', 'Mockito-18', 'Math-57', 'Math-41', 'Chart-1', 'Mockito-29', 'Lang-52', 'Closure-52', 'Closure-77', 'Lang-33', 'Chart-11', 'Math-85', 'Closure-57', 'Mockito-24'
Same: 'Math-57', 'Closure-52', 'Lang-29', 'Math-50', 'Chart-20', 'Math-85', 'Mockito-18', 'Lang-21', 'Chart-11', 'Closure-57', 'Chart-1', 'Math-41', 'Lang-52', 'Closure-77'
GPT-3.5-ChatRepair-0.5
Plausible: 'Chart-1', 'Chart-10', 'Chart-11', 'Chart-13', 'Chart-20', 'Chart-24', 'Chart-8', 'Chart-9', 'Closure-10', 'Closure-107', 'Closure-11', 'Closure-119', 'Closure-122', 'Closure-126', 'Closure-129', 'Closure-15', 'Closure-18', 'Closure-19', 'Closure-38', 'Closure-5', 'Closure-52', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-65', 'Closure-66', 'Closure-70', 'Closure-73', 'Closure-77', 'Closure-86', 'Closure-97', 'Lang-14', 'Lang-16', 'Lang-21', 'Lang-22', 'Lang-24', 'Lang-29', 'Lang-33', 'Lang-37', 'Lang-39', 'Lang-43', 'Lang-44', 'Lang-45', 'Lang-52', 'Lang-58', 'Lang-59', 'Lang-61', 'Math-10', 'Math-101', 'Math-32', 'Math-33', 'Math-34', 'Math-41', 'Math-45', 'Math-5', 'Math-50', 'Math-53', 'Math-56', 'Math-57', 'Math-59', 'Math-63', 'Math-70', 'Math-73', 'Math-80', 'Math-82', 'Math-85', 'Math-89', 'Math-91', 'Math-94', 'Mockito-12', 'Mockito-18', 'Mockito-24', 'Mockito-29', 'Mockito-8', 'Time-15', 'Time-19', 'Time-4'
Correct: 'Closure-86', 'Lang-61', 'Closure-97', 'Lang-43', 'Closure-65', 'Closure-70', 'Math-10', 'Chart-9', 'Mockito-29', 'Closure-66', 'Math-82', 'Chart-20', 'Closure-62', 'Chart-11', 'Lang-52', 'Time-19', 'Math-80', 'Closure-119', 'Lang-44', 'Lang-21', 'Closure-5', 'Math-85', 'Lang-29', 'Closure-18', 'Chart-24', 'Lang-59', 'Time-4', 'Mockito-18', 'Math-59', 'Lang-24', 'Math-41', 'Time-15', 'Math-56', 'Mockito-24', 'Math-89', 'Closure-126', 'Math-91', 'Math-57', 'Math-53', 'Lang-16', 'Closure-73', 'Chart-1', 'Mockito-12', 'Closure-15', 'Closure-61', 'Math-94', 'Lang-45', 'Lang-39', 'Math-73', 'Closure-19', 'Closure-38', 'Lang-33', 'Closure-129', 'Chart-8', 'Closure-77', 'Closure-57', 'Lang-14'
Same: 'Closure-126', 'Math-91', 'Closure-57', 'Lang-45', 'Closure-66', 'Chart-24', 'Time-15', 'Lang-61', 'Mockito-29', 'Chart-9', 'Chart-11', 'Closure-19', 'Closure-77', 'Lang-39', 'Chart-8', 'Lang-29', 'Closure-38', 'Closure-86', 'Closure-73', 'Lang-43', 'Closure-18', 'Lang-44', 'Lang-21', 'Lang-33', 'Math-80', 'Closure-119', 'Math-41', 'Math-85', 'Chart-1', 'Closure-129', 'Closure-62', 'Time-19', 'Lang-16', 'Lang-24', 'Math-82', 'Math-57', 'Math-94', 'Closure-65', 'Closure-70', 'Mockito-18', 'Mockito-12', 'Math-10', 'Time-4', 'Closure-15', 'Lang-52', 'Chart-20'
GPT-3.5-ChatRepair-0.8
Plausible: 'Chart-1', 'Chart-10', 'Chart-11', 'Chart-13', 'Chart-17', 'Chart-20', 'Chart-24', 'Chart-8', 'Chart-9', 'Closure-10', 'Closure-107', 'Closure-11', 'Closure-119', 'Closure-122', 'Closure-126', 'Closure-129', 'Closure-15', 'Closure-19', 'Closure-31', 'Closure-5', 'Closure-52', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-65', 'Closure-66', 'Closure-70', 'Closure-73', 'Closure-77', 'Closure-86', 'Closure-92', 'Lang-14', 'Lang-16', 'Lang-21', 'Lang-22', 'Lang-24', 'Lang-29', 'Lang-33', 'Lang-37', 'Lang-39', 'Lang-44', 'Lang-45', 'Lang-51', 'Lang-52', 'Lang-59', 'Lang-61', 'Math-10', 'Math-101', 'Math-105', 'Math-19', 'Math-32', 'Math-33', 'Math-34', 'Math-39', 'Math-41', 'Math-45', 'Math-48', 'Math-5', 'Math-50', 'Math-53', 'Math-56', 'Math-57', 'Math-59', 'Math-70', 'Math-73', 'Math-75', 'Math-80', 'Math-82', 'Math-85', 'Math-89', 'Math-91', 'Math-94', 'Math-96', 'Mockito-12', 'Mockito-18', 'Mockito-24', 'Mockito-29', 'Mockito-38', 'Time-15', 'Time-19'
Correct: 'Math-41', 'Time-19', 'Chart-11', 'Time-15', 'Math-56', 'Chart-1', 'Lang-33', 'Lang-45', 'Lang-61', 'Math-57', 'Mockito-12', 'Chart-8', 'Math-5', 'Closure-19', 'Closure-86', 'Math-94', 'Closure-65', 'Math-75', 'Math-59', 'Math-80', 'Chart-24', 'Closure-73', 'Mockito-18', 'Math-53', 'Lang-24', 'Closure-92', 'Math-91', 'Lang-44', 'Closure-31', 'Math-73', 'Math-105', 'Mockito-24', 'Math-89', 'Closure-77', 'Math-10', 'Lang-59', 'Lang-21', 'Math-48', 'Closure-66', 'Closure-57 Closure-62', 'Closure-15', 'Closure-119', 'Math-85', 'Lang-39', 'Closure-61', 'Lang-52', 'Closure-5', 'Lang-16', 'Math-70', 'Closure-129', 'Math-82', 'Chart-9', 'Lang-29', 'Chart-20', 'Chart-13', 'Mockito-29', 'Closure-70'
Same: 'Lang-39', 'Closure-19', 'Lang-45', 'Chart-11', 'Chart-1', 'Closure-86', 'Chart-20', 'Math-5', 'Math-48', 'Lang-16', 'Closure-57 Closure-62', 'Lang-61', 'Math-82', 'Lang-44', 'Math-75', 'Time-19', 'Closure-92', 'Chart-9', 'Closure-129', 'Mockito-12', 'Lang-24', 'Closure-73', 'Math-10', 'Time-15', 'Closure-77', 'Math-41', 'Chart-13', 'Math-57', 'Math-85', 'Math-80', 'Closure-66', 'Closure-119', 'Closure-15', 'Lang-29', 'Chart-24', 'Closure-70', 'Lang-52', 'Chart-8', 'Closure-65', 'Math-94', 'Lang-21'
GPT-3.5-ChatRepair-1.0
Plausible: 'Chart-1', 'Chart-10', 'Chart-11', 'Chart-13', 'Chart-17', 'Chart-20', 'Chart-24', 'Chart-8', 'Chart-9', 'Closure-107', 'Closure-109', 'Closure-11', 'Closure-119', 'Closure-122', 'Closure-124', 'Closure-125', 'Closure-126', 'Closure-129', 'Closure-15', 'Closure-19', 'Closure-36', 'Closure-52', 'Closure-56', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-65', 'Closure-70', 'Closure-73', 'Closure-77', 'Closure-86', 'Closure-92', 'Closure-97', 'Lang-21', 'Lang-22', 'Lang-24', 'Lang-29', 'Lang-33', 'Lang-37', 'Lang-39', 'Lang-43', 'Lang-44', 'Lang-45', 'Lang-51', 'Lang-52', 'Lang-57', 'Lang-58', 'Lang-59', 'Lang-61', 'Lang-9', 'Math-10', 'Math-101', 'Math-105', 'Math-3', 'Math-30', 'Math-32', 'Math-34', 'Math-41', 'Math-45', 'Math-5', 'Math-50', 'Math-53', 'Math-56', 'Math-57', 'Math-59', 'Math-69', 'Math-73', 'Math-80', 'Math-82', 'Math-85', 'Math-89', 'Math-91', 'Math-94', 'Mockito-12', 'Mockito-18', 'Mockito-24', 'Mockito-29', 'Mockito-34', 'Mockito-38', 'Time-15', 'Time-19', 'Time-4'
Correct: 'Math-105', 'Chart-24', 'Lang-29', 'Chart-13', 'Lang-52', 'Math-34', 'Math-5', 'Math-80', 'Closure-73', 'Closure-86', 'Math-10', 'Chart-1', 'Math-59', 'Closure-15', 'Closure-61', 'Lang-33', 'Math-82', 'Mockito-18', 'Closure-77', 'Mockito-29', 'Chart-11', 'Closure-62', 'Closure-65', 'Math-45', 'Math-94', 'Mockito-12', 'Time-15', 'Time-4', 'Math-32', 'Math-56', 'Lang-39', 'Math-91', 'Lang-44', 'Closure-97', 'Chart-9', 'Math-53', 'Closure-57', 'Lang-59', 'Closure-70', 'Closure-92', 'Chart-20', 'Mockito-24', 'Math-57', 'Math-41', 'Closure-125', 'Lang-45', 'Math-73', 'Closure-36', 'Mockito-34', 'Closure-119', 'Lang-24', 'Lang-61', 'Closure-129', 'Lang-43', 'Closure-19', 'Math-85', 'Lang-21', 'Math-3', 'Chart-8'
Same: 'Math-56', 'Lang-24', 'Closure-36', 'Lang-61', 'Lang-52', 'Lang-45', 'Lang-39', 'Chart-13', 'Closure-97', 'Closure-70', 'Math-85', 'Lang-59', 'Math-5', 'Mockito-12', 'Closure-15', 'Math-57', 'Math-10', 'Chart-11', 'Closure-119', 'Closure-92', 'Mockito-34', 'Closure-65', 'Chart-24', 'Lang-43', 'Math-41', 'Lang-33', 'Math-82', 'Chart-8', 'Lang-21', 'Math-94', 'Time-15', 'Math-91', 'Chart-9', 'Mockito-18', 'Math-3', 'Math-80', 'Closure-129', 'Lang-29', 'Closure-73', 'Lang-44', 'Closure-86', 'Time-4', 'Closure-62', 'Closure-77', 'Closure-57', 'Chart-1', 'Chart-20', 'Math-45', 'Closure-19', 'Closure-61'
GPT-3.5-MemPrompt-0
Plausible: 'Chart-11', 'Chart-20', 'Closure-124', 'Closure-19', 'Closure-31', 'Closure-57', 'Closure-70', 'Lang-21', 'Lang-29', 'Lang-43', 'Lang-58', 'Math-41', 'Math-57'
Correct: 'Closure-57', 'Closure-31', 'Lang-21', 'Lang-29', 'Lang-43', 'Closure-70', 'Math-41', 'Chart-11', 'Math-57', 'Chart-20', 'Closure-19'
Same: 'Closure-31', 'Closure-19', 'Math-41', 'Closure-70', 'Closure-57', 'Chart-11', 'Lang-21', 'Math-57', 'Lang-29', 'Chart-20'
GPT-3.5-MemPrompt-0.5
Plausible: 'Chart-1', 'Chart-11', 'Chart-13', 'Chart-20', 'Chart-24', 'Closure-10', 'Closure-107', 'Closure-11', 'Closure-122', 'Closure-124', 'Closure-125', 'Closure-126', 'Closure-129', 'Closure-19', 'Closure-31', 'Closure-38', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-66', 'Closure-70', 'Closure-73', 'Closure-86', 'Closure-92', 'Closure-97', 'Lang-16', 'Lang-21', 'Lang-22', 'Lang-24', 'Lang-29', 'Lang-33', 'Lang-43', 'Lang-45', 'Lang-58', 'Lang-59', 'Lang-61', 'Math-101', 'Math-2', 'Math-27', 'Math-30', 'Math-32', 'Math-33', 'Math-41', 'Math-5', 'Math-50', 'Math-56', 'Math-57', 'Math-59', 'Math-80', 'Math-82', 'Math-85', 'Math-89', 'Math-91', 'Math-94', 'Math-96', 'Mockito-24', 'Mockito-29', 'Time-15', 'Time-19'
Correct: 'Mockito-24', 'Closure-129', 'Lang-45', 'Math-56', 'Lang-59', 'Closure-62', 'Closure-86', 'Chart-20', 'Lang-21', 'Lang-29', 'Closure-61', 'Chart-24', 'Closure-126', 'Math-5', 'Lang-58', 'Closure-66', 'Closure-92', 'Math-27', 'Math-41', 'Closure-31', 'Chart-1', 'Closure-19', 'Math-57', 'Lang-16', 'Lang-61', 'Math-50', 'Closure-70', 'Time-15', 'Math-94', 'Math-85', 'Lang-33', 'Closure-124', 'Closure-73', 'Math-59', 'Lang-43', 'Math-33', 'Chart-11', 'Math-82', 'Math-80', 'Closure-57', 'Math-91'
Same: 'Math-33', 'Math-85', 'Math-82', 'Math-5', 'Closure-92', 'Closure-86', 'Lang-61', 'Closure-126', 'Chart-24', 'Math-80', 'Closure-70', 'Time-15', 'Lang-45', 'Math-91', 'Closure-73', 'Math-57', 'Chart-20', 'Lang-21', 'Closure-19', 'Chart-11', 'Chart-1', 'Lang-29', 'Closure-66', 'Closure-129', 'Math-41', 'Closure-62', 'Math-56', 'Closure-31', 'Math-50', 'Lang-43', 'Closure-57', 'Math-94'
GPT-3.5-MemPrompt-0.8
Plausible: 'Chart-1', 'Chart-10', 'Chart-11', 'Chart-13', 'Chart-20', 'Chart-24', 'Chart-8', 'Chart-9', 'Closure-107', 'Closure-11', 'Closure-122', 'Closure-126', 'Closure-129', 'Closure-18', 'Closure-19', 'Closure-31', 'Closure-5', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-73', 'Closure-92', 'Closure-97', 'Lang-21', 'Lang-22', 'Lang-24', 'Lang-29', 'Lang-33', 'Lang-43', 'Lang-45', 'Lang-58', 'Lang-59', 'Lang-61', 'Math-11', 'Math-2', 'Math-30', 'Math-32', 'Math-33', 'Math-41', 'Math-5', 'Math-50', 'Math-56', 'Math-57', 'Math-59', 'Math-80', 'Math-82', 'Math-85', 'Math-89', 'Math-91', 'Math-94', 'Mockito-12', 'Mockito-24', 'Mockito-29', 'Time-15', 'Time-4'
Correct: 'Chart-20', 'Math-57', 'Closure-62', 'Closure-18', 'Closure-129', 'Lang-29', 'Lang-24', 'Chart-24', 'Lang-43', 'Math-91', 'Math-85', 'Closure-126', 'Closure-92', 'Math-56', 'Time-15', 'Closure-31', 'Math-5', 'Mockito-29', 'Math-11', 'Closure-73', 'Closure-19', 'Chart-1', 'Chart-11', 'Lang-59', 'Closure-57', 'Math-80', 'Math-82', 'Lang-33', 'Closure-5', 'Mockito-24', 'Chart-8', 'Lang-61', 'Time-4', 'Math-41', 'Mockito-12', 'Lang-21', 'Math-59', 'Math-50', 'Closure-61', 'Lang-45', 'Math-94'
Same: 'Chart-11', 'Lang-45', 'Mockito-12', 'Closure-62', 'Math-57', 'Chart-24', 'Math-82', 'Lang-29', 'Math-5', 'Lang-24', 'Closure-57', 'Closure-92', 'Closure-18', 'Time-15', 'Closure-31', 'Closure-73', 'Math-85', 'Lang-21', 'Lang-61', 'Math-41', 'Math-80', 'Time-4', 'Closure-19', 'Chart-20', 'Math-50', 'Closure-126', 'Math-56', 'Closure-129', 'Math-94', 'Chart-8', 'Chart-1'
GPT-3.5-MemPrompt-1.0
Plausible: 'Chart-1', 'Chart-11', 'Chart-13', 'Chart-20', 'Chart-24', 'Chart-9', 'Closure-10', 'Closure-107', 'Closure-11', 'Closure-122', 'Closure-124', 'Closure-126', 'Closure-129', 'Closure-18', 'Closure-19', 'Closure-31', 'Closure-38', 'Closure-5', 'Closure-57', 'Closure-61', 'Closure-62', 'Closure-70', 'Closure-86', 'Closure-92', 'Closure-97', 'Lang-16', 'Lang-21', 'Lang-22', 'Lang-24', 'Lang-29', 'Lang-33', 'Lang-37', 'Lang-43', 'Lang-45', 'Lang-51', 'Lang-52', 'Lang-58', 'Lang-59', 'Lang-61', 'Math-11', 'Math-30', 'Math-32', 'Math-33', 'Math-41', 'Math-50', 'Math-53', 'Math-57', 'Math-59', 'Math-70', 'Math-80', 'Math-82', 'Math-85', 'Math-89', 'Math-91', 'Math-94', 'Mockito-12', 'Mockito-24', 'Mockito-29', 'Mockito-34', 'Time-15'
Correct: 'Lang-21', 'Chart-20', 'Math-85', 'Closure-70', 'Closure-31', 'Closure-129', 'Lang-59', 'Math-80', 'Closure-57', 'Lang-24', 'Mockito-29', 'Lang-16', 'Closure-92', 'Closure-19', 'Lang-61', 'Closure-126', 'Math-32', 'Closure-86', 'Chart-11', 'Time-15', 'Math-94', 'Lang-33', 'Chart-1', 'Mockito-34', 'Closure-61', 'Closure-5', 'Closure-62', 'Math-57', 'Closure-18', 'Mockito-24', 'Chart-24', 'Lang-45', 'Math-59', 'Closure-11', 'Math-50', 'Math-53', 'Math-41', 'Closure-97', 'Lang-29', 'Closure-124', 'Math-70', 'Lang-52', 'Math-82', 'Lang-43'
Same: 'Closure-86', 'Lang-59', 'Lang-61', 'Math-85', 'Closure-57', 'Closure-129', 'Math-41', 'Closure-31', 'Math-94', 'Closure-11', 'Lang-21', 'Chart-1', 'Lang-45', 'Closure-62', 'Math-80', 'Closure-126', 'Lang-24', 'Lang-52', 'Time-15', 'Math-50', 'Chart-20', 'Chart-11', 'Math-82', 'Closure-19', 'Lang-29', 'Mockito-34', 'Lang-43', 'Chart-24', 'Math-57', 'Closure-18', 'Closure-92'
CodeLlama-ChatRepair-0
Plausible: 'Chart-11', 'Math-80'
Correct: 'Chart-11'
Same: 'Chart-11'
CodeLlama-ChatRepair-0.5
Plausible: 'Math-105', 'Mockito-34', 'Lang-22', 'Closure-65', 'Time-19', 'Closure-86', 'Math-73', 'Math-50', 'Math-82', 'Math-75', 'Math-30', 'Chart-9', 'Lang-44', 'Lang-51', 'Chart-11', 'Lang-28', 'Math-34', 'Math-96', 'Math-80', 'Chart-8', 'Mockito-38', 'Lang-39', 'Math-41', 'Closure-126', 'Chart-13', 'Math-5', 'Math-53', 'Closure-77', 'Lang-37', 'Math-56', 'Closure-62', 'Math-94', 'Math-3', 'Closure-18', 'Closure-11', 'Math-2', 'Chart-24', 'Closure-122', 'Mockito-33', 'Lang-21', 'Lang-24', 'Lang-45', 'Closure-31', 'Lang-26', 'Mockito-24', 'Chart-10', 'Lang-33', 'Chart-20', 'Closure-125', 'Mockito-29', 'Math-85', 'Math-33', 'Closure-19', 'Lang-57', 'Lang-59', 'Chart-1', 'Closure-123', 'Math-59', 'Math-89', 'Lang-29', 'Closure-10', 'Closure-73'
Correct: 'Math-75', 'Math-82', 'Closure-11', 'Closure-31', 'Math-56', 'Closure-18', 'Chart-20', 'Closure-62', 'Math-96', 'Mockito-38', 'Closure-19', 'Closure-77', 'Math-34', 'Math-3', 'Lang-21', 'Math-80', 'Closure-126', 'Chart-9', 'Lang-24', 'Lang-51', 'Math-5', 'Closure-123', 'Mockito-29', 'Mockito-24', 'Math-41', 'Chart-8', 'Math-59', 'Math-89', 'Lang-26', 'Closure-86', 'Lang-29', 'Mockito-33', 'Math-33', 'Chart-11', 'Math-53', 'Lang-59', 'Chart-24', 'Math-94', 'Closure-10', 'Closure-65', 'Chart-13', 'Closure-73', 'Lang-45', 'Lang-33', 'Math-85'
Same: 'Chart-13', 'Closure-10', 'Math-89', 'Closure-18', 'Closure-19', 'Chart-11', 'Math-80', 'Closure-62', 'Chart-20', 'Chart-8', 'Math-75', 'Chart-9', 'Closure-77', 'Closure-86', 'Math-94', 'Lang-29', 'Chart-24', 'Math-82', 'Math-3', 'Lang-45', 'Lang-33', 'Closure-31', 'Closure-123', 'Math-85', 'Math-59', 'Lang-21', 'Closure-65', 'Closure-73', 'Math-5', 'Lang-24', 'Closure-11', 'Lang-26', 'Math-33', 'Math-41'
CodeLlama-ChatRepair-0.8
Plausible: 'Math-57', 'Math-105', 'Chart-20', 'Math-94', 'Math-96', 'Closure-123', 'Math-10', 'Chart-24', 'Lang-21', 'Closure-122', 'Chart-8', 'Math-41', 'Closure-126', 'Math-34', 'Closure-10', 'Math-89', 'Closure-73', 'Lang-59', 'Closure-65', 'Lang-33', 'Chart-1', 'Math-73', 'Closure-77', 'Closure-62', 'Math-59', 'Math-3', 'Chart-11', 'Math-82', 'Math-11', 'Chart-13', 'Math-85', 'Closure-125', 'Lang-29', 'Lang-58', 'Lang-45', 'Time-15', 'Math-30', 'Mockito-38', 'Lang-37', 'Lang-24', 'Math-33', 'Closure-129', 'Mockito-24', 'Lang-22', 'Math-75', 'Closure-31', 'Math-80', 'Mockito-34', 'Math-53', 'Time-19', 'Closure-18', 'Lang-39', 'Closure-86', 'Mockito-29', 'Lang-51', 'Lang-26', 'Closure-11', 'Math-63', 'Chart-10', 'Math-5', 'Lang-16', 'Closure-19', 'Closure-97', 'Math-56', 'Mockito-5', 'Lang-43', 'Lang-57', 'Math-50'
Correct: 'Closure-31', 'Closure-73', 'Lang-45', 'Closure-123', 'Closure-19', 'Math-105', 'Math-96', 'Math-33', 'Math-41', 'Closure-65', 'Lang-16', 'Closure-77', 'Lang-26', 'Chart-11', 'Lang-43', 'Mockito-38', 'Closure-18', 'Math-59', 'Math-82', 'Time-15', 'Lang-59', 'Math-94', 'Math-11', 'Chart-1', 'Closure-62', 'Lang-39', 'Closure-86', 'Lang-24', 'Math-3', 'Lang-33', 'Math-75', 'Time-19', 'Math-34', 'Math-53', 'Chart-20', 'Math-10', 'Math-89', 'Math-5', 'Math-57', 'Math-56', 'Chart-13', 'Chart-8', 'Math-30', 'Lang-51', 'Chart-24', 'Closure-11', 'Mockito-5', 'Lang-21', 'Lang-29'
Same: 'Chart-1', 'Closure-11', 'Math-30', 'Chart-8', 'Math-75', 'Chart-24', 'Math-41', 'Lang-33', 'Time-19', 'Math-59', 'Lang-16', 'Math-89', 'Chart-11', 'Time-15', 'Closure-62', 'Closure-73', 'Lang-21', 'Math-5', 'Lang-39', 'Math-82', 'Lang-45', 'Math-56', 'Closure-86', 'Math-94', 'Lang-29', 'Lang-59', 'Lang-43', 'Math-3', 'Lang-24', 'Closure-65', 'Closure-31', 'Math-57', 'Math-33', 'Math-10', 'Lang-26', 'Closure-123', 'Chart-13', 'Math-11', 'Closure-18', 'Mockito-5', 'Closure-77', 'Closure-19', 'Math-105', 'Mockito-38', 'Chart-20'
CodeLlama-ChatRepair-1.0
Plausible: 'Lang-45', 'Math-11', 'Math-63', 'Closure-122', 'Lang-26', 'Lang-38', 'Chart-8', 'Lang-43', 'Closure-73', 'Closure-83', 'Lang-59', 'Math-34', 'Closure-65', 'Chart-20', 'Chart-9', 'Chart-11', 'Lang-57', 'Lang-21', 'Closure-10', 'Math-32', 'Time-19', 'Math-59', 'Math-5', 'Closure-129', 'Math-58', 'Closure-19', 'Lang-55', 'Mockito-1', 'Lang-29', 'Mockito-38', 'Mockito-29', 'Closure-77', 'Lang-22', 'Math-73', 'Closure-31', 'Chart-13', 'Math-80', 'Math-33', 'Math-41', 'Math-105', 'Math-96', 'Math-50', 'Closure-57', 'Math-94', 'Lang-51', 'Chart-1', 'Math-89', 'Lang-16', 'Math-53', 'Lang-58', 'Lang-37', 'Math-3', 'Math-30', 'Closure-11', 'Chart-24', 'Math-57', 'Lang-24', 'Math-75', 'Chart-10', 'Math-2', 'Closure-18', 'Closure-126', 'Closure-123', 'Closure-62', 'Math-85', 'Lang-39', 'Math-27', 'Lang-33', 'Closure-86', 'Math-82', 'Mockito-34'
Correct: 'Closure-18', 'Math-27', 'Mockito-34', 'Chart-11', 'Closure-62', 'Math-41', 'Lang-55', 'Chart-8', 'Closure-11', 'Time-19', 'Mockito-29', 'Mockito-38', 'Lang-57', 'Math-75', 'Math-58', 'Chart-24', 'Math-3', 'Closure-19', 'Chart-1', 'Lang-33', 'Closure-31', 'Lang-21', 'Math-11', 'Math-33', 'Math-34', 'Math-5', 'Closure-73', 'Lang-45', 'Closure-83', 'Math-80', 'Math-57', 'Math-89', 'Chart-13', 'Closure-77', 'Closure-65', 'Lang-16', 'Closure-123', 'Lang-29', 'Chart-20', 'Math-94', 'Math-59', 'Lang-24', 'Math-96', 'Closure-57', 'Closure-86', 'Math-30', 'Math-105', 'Lang-59', 'Lang-43', 'Closure-126'
Same: 'Chart-11', 'Chart-1', 'Closure-18', 'Math-80', 'Math-94', 'Closure-83', 'Lang-45', 'Closure-57', 'Chart-24', 'Math-75', 'Closure-123', 'Closure-31', 'Math-89', 'Closure-77', 'Chart-13', 'Closure-86', 'Lang-33', 'Math-30', 'Closure-19', 'Chart-8', 'Time-19', 'Math-105', 'Closure-62', 'Lang-29', 'Math-57', 'Closure-126', 'Closure-65', 'Math-3', 'Closure-11', 'Math-5', 'Math-58', 'Chart-20', 'Math-41', 'Lang-59', 'Lang-21', 'Closure-73', 'Math-27', 'Lang-24', 'Lang-43'
CodeLlama-MemPrompt-0
Plausible: 'Closure-123', 'Closure-31', 'Closure-62', 'Lang-58', 'Chart-11', 'Math-41', 'Closure-86', 'Chart-20', 'Math-32', 'Lang-39'
Correct: 'Math-41', 'Chart-20', 'Chart-11', 'Closure-62'
Same: 'Math-41', 'Chart-20', 'Chart-11', 'Closure-62'
CodeLlama-MemPrompt-0.5
Plausible: 'Math-89', 'Closure-57', 'Time-4', 'Math-57', 'Chart-1', 'Closure-92', 'Math-80', 'Math-96', 'Math-11', 'Chart-10', 'Lang-22', 'Lang-59', 'Mockito-38', 'Chart-24', 'Math-2', 'Time-19', 'Lang-24', 'Math-63', 'Math-82', 'Math-34', 'Math-27', 'Closure-18', 'Closure-31', 'Closure-86', 'Closure-123', 'Closure-126', 'Math-59', 'Lang-33', 'Math-30', 'Lang-21', 'Chart-8', 'Chart-13', 'Math-58', 'Closure-129', 'Lang-58', 'Math-85', 'Math-70', 'Math-10', 'Math-41', 'Chart-20', 'Math-94', 'Closure-10', 'Closure-19', 'Math-32', 'Lang-45', 'Lang-16', 'Closure-73', 'Closure-61', 'Math-5', 'Closure-11', 'Lang-55', 'Math-50', 'Chart-11', 'Lang-51', 'Closure-62'
Correct: 'Lang-16', 'Closure-86', 'Math-58', 'Math-57', 'Closure-11', 'Closure-18', 'Math-59', 'Lang-21', 'Math-70', 'Math-30', 'Lang-33', 'Chart-20', 'Chart-11', 'Math-94', 'Chart-1', 'Lang-59', 'Closure-57', 'Math-11', 'Math-82', 'Math-10', 'Closure-61', 'Closure-62', 'Math-41', 'Chart-13', 'Math-27', 'Math-89', 'Chart-8', 'Closure-73', 'Math-96', 'Closure-123', 'Math-85', 'Closure-10', 'Lang-45', 'Chart-24'
Same: 'Math-59', 'Chart-24', 'Closure-73', 'Chart-11', 'Math-58', 'Math-82', 'Closure-86', 'Lang-21', 'Math-89', 'Chart-13', 'Math-41', 'Chart-8', 'Math-30', 'Math-85', 'Closure-18', 'Closure-123', 'Closure-62', 'Math-70', 'Chart-1', 'Chart-20', 'Closure-57', 'Math-11', 'Math-27', 'Closure-11', 'Math-57', 'Closure-10', 'Math-10', 'Math-94', 'Lang-45'
CodeLlama-MemPrompt-0.8
Plausible: 'Math-50', 'Math-94', 'Lang-16', 'Math-73', 'Closure-18', 'Closure-62', 'Math-82', 'Math-41', 'Math-30', 'Math-63', 'Math-2', 'Closure-59', 'Lang-24', 'Closure-125', 'Math-80', 'Lang-22', 'Time-15', 'Lang-29', 'Lang-45', 'Closure-19', 'Mockito-38', 'Closure-31', 'Math-57', 'Math-89', 'Chart-11', 'Lang-57', 'Closure-129', 'Chart-10', 'Math-11', 'Math-85', 'Lang-43', 'Math-70', 'Mockito-33', 'Closure-86', 'Closure-123', 'Chart-24', 'Chart-13', 'Lang-21', 'Lang-33', 'Closure-97', 'Math-32', 'Math-59', 'Lang-51', 'Chart-20', 'Math-58', 'Math-96', 'Closure-11', 'Closure-10', 'Closure-126', 'Chart-1', 'Chart-8', 'Closure-92'
Correct: 'Math-82', 'Closure-126', 'Math-57', 'Lang-21', 'Closure-10', 'Closure-86', 'Lang-16', 'Chart-11', 'Math-11', 'Math-96', 'Mockito-33', 'Chart-8', 'Lang-45', 'Chart-1', 'Closure-92', 'Chart-20', 'Math-89', 'Closure-19', 'Lang-33', 'Math-85', 'Math-59', 'Closure-11', 'Lang-43', 'Math-70', 'Math-30', 'Chart-13', 'Math-58', 'Closure-123', 'Closure-62', 'Time-15', 'Math-41', 'Closure-18', 'Chart-24', 'Lang-29', 'Math-94', 'Closure-31'
Same: 'Math-85', 'Math-57', 'Closure-18', 'Math-58', 'Lang-16', 'Closure-11', 'Closure-10', 'Closure-92', 'Closure-62', 'Chart-11', 'Chart-13', 'Lang-21', 'Closure-19', 'Math-59', 'Lang-43', 'Lang-29', 'Closure-31', 'Math-70', 'Closure-123', 'Math-82', 'Chart-1', 'Math-41', 'Closure-86', 'Chart-20', 'Math-30', 'Chart-8', 'Lang-45', 'Math-89', 'Math-94', 'Time-15', 'Lang-33'
CodeLlama-MemPrompt-1.0
Plausible: 'Closure-57', 'Chart-8', 'Math-59', 'Time-19', 'Closure-92', 'Closure-126', 'Math-96', 'Closure-31', 'Math-32', 'Closure-62', 'Lang-57', 'Math-57', 'Math-41', 'Lang-24', 'Lang-22', 'Math-30', 'Closure-86', 'Math-80', 'Mockito-24', 'Closure-18', 'Closure-123', 'Chart-11', 'Closure-10', 'Lang-51', 'Lang-45', 'Lang-29', 'Lang-59', 'Math-82', 'Chart-13', 'Math-11', 'Mockito-38', 'Math-75', 'Lang-16', 'Lang-58', 'Lang-33', 'Closure-125', 'Lang-55', 'Closure-19', 'Closure-122', 'Math-50', 'Chart-20', 'Chart-1', 'Math-70', 'Closure-11', 'Closure-129', 'Math-63', 'Chart-24', 'Math-94', 'Closure-73', 'Math-58', 'Math-85', 'Closure-70', 'Math-2', 'Closure-109', 'Math-34', 'Lang-21'
Correct: 'Chart-11', 'Closure-86', 'Closure-31', 'Lang-57', 'Chart-20', 'Closure-125', 'Closure-18', 'Math-85', 'Closure-73', 'Closure-70', 'Math-57', 'Math-41', 'Lang-21', 'Math-96', 'Lang-45', 'Chart-8', 'Chart-13', 'Closure-57', 'Closure-126', 'Closure-123', 'Math-34', 'Math-30', 'Lang-29', 'Math-82', 'Math-94', 'Math-59', 'Math-50', 'Closure-19', 'Math-58', 'Math-11', 'Mockito-24', 'Lang-24', 'Lang-55', 'Closure-62', 'Math-75', 'Closure-11', 'Closure-10', 'Chart-1', 'Lang-59', 'Math-70'
Same: 'Chart-8', 'Math-57', 'Math-11', 'Closure-86', 'Closure-62', 'Math-50', 'Math-58', 'Lang-21', 'Closure-57', 'Closure-19', 'Chart-1', 'Chart-20', 'Math-94', 'Math-75', 'Closure-123', 'Lang-45', 'Closure-18', 'Lang-24', 'Math-70', 'Closure-31', 'Chart-13', 'Closure-70', 'Closure-11', 'Math-59', 'Lang-55', 'Math-82', 'Closure-126', 'Math-85', 'Math-41', 'Math-30', 'Lang-29', 'Closure-73', 'Chart-11'
Here are the specific bugs for each setting on the dataset GitBug-Java. Specifically, bugs with large search space and small search space are as follows.
Bugs-Large: "jhy-jsoup-e52224fbfe66", "AuthMe-ConfigMe-aa91a6b315ec", "LMAX-Exchange-Simple-DSL-81182e58bd80", "Netflix-frigga-126b52a55863", "TheAlgorithms-Java-4f1514980495", "TheAlgorithms-Java-96c1a96647c9", "TheAlgorithms-Java-a3a2d845d563", "aws-aws-secretsmanager-jdbc-d25e52d637cf", "beanshell-beanshell-f345606a29bd", "cdimascio-dotenv-java-bbfbcfa63e3a", "fishercoder1534-Leetcode-2110c6b023b7", "fusesource-jansi-58260c6ce08c", "gitbucket-markedj-2dce74e12083", "gradle-common-custom-user-data-gradle-plugin-982c77984b5e", "jhy-jsoup-1e69577e358c", "jhy-jsoup-2a4a9cf83dea", "jhy-jsoup-5f20fcc2f728", "jhy-jsoup-6ccd158754e2", "jhy-jsoup-8e2b86839b27", "jhy-jsoup-9e5869b6e1e2", "jhy-jsoup-29be991198d3", "jhy-jsoup-45ed00232722", "jhy-jsoup-111919256590", "jhy-jsoup-a349582236a7", "jitterted-ensembler-14a39138787f", "mthmulders-mcs-eff905bef8d8", "retel-io-ari-proxy-610e9b6725e1", "revelc-formatter-maven-plugin-3e9843d2ab99", "semver4j-semver4j-10102b374298", "spring-projects-spring-retry-e6091f790c64", "stellar-java-stellar-sdk-15cc6d2c8131", "stellar-java-stellar-sdk-1461c2fc5b89", "traccar-traccar-3b6900a95342", "traccar-traccar-4a5b8d79b560", "traccar-traccar-4ece72558c80", "traccar-traccar-8de9a36abef8", "traccar-traccar-9a1cbeb7b754", "traccar-traccar-230f629c3dce", "traccar-traccar-392f00082faf", "traccar-traccar-2749e520c9ea", "traccar-traccar-6631d7c4b352", "traccar-traccar-553527d9fbe6", "traccar-traccar-cadcd2676adb", "traccar-traccar-dfc546a26f5b", "traccar-traccar-e73f36db83b9", "traccar-traccar-f4d10160d951", "vmzakharov-dataframe-ec-12af99192d24", "xtremexp-UT4X-Converter-e719841eb260"
Bugs-Small: "cloudsimplus-cloudsimplus-61c8b942d1ec", "TheAlgorithms-Java-e5c7a08874a6", "crawler-commons-crawler-commons-2c2cb3bf7a95", "davidmoten-openapi-to-plantuml-773340861981", "jhy-jsoup-9bb07d2ab43c", "jhy-jsoup-195f484ba5de", "jitterted-ensembler-0e512e5b3677", "jitterted-ensembler-0963194c9ebc", "snowflakedb-snowflake-jdbc-f2c8eba73535", "traccar-traccar-1b8993293646", "traccar-traccar-5a1a8d9192ee", "traccar-traccar-6e5481ebb185", "traccar-traccar-6f59f756a7d3", "traccar-traccar-7ce4fb9a628f", "traccar-traccar-3642b9520863", "traccar-traccar-3331593759a2", "traccar-traccar-a9c311855a49", "traccar-traccar-d244b4bc4999", "traccar-traccar-ed3950fbdccf", "traccar-traccar-fdbd269b9b99"
GPT-3.5-ChatRepair-0
Plausible: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-e5c7a08874a6', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-9bb07d2ab43c', 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-d244b4bc4999'
Correct: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-e5c7a08874a6', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-9bb07d2ab43c', 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-d244b4bc4999'
Same: 'jhy-jsoup-9bb07d2ab43c', 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-d244b4bc4999'
GPT-3.5-ChatRepair-0.5
Plausible: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'jhy-jsoup-8e2b86839b27', ‘jhy-jsoup-9bb07d2ab43c’, 'jhy-jsoup-195f484ba5de', 'jhy-jsoup-e52224fbfe66', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'jitterted-ensembler-14a39138787f', 'traccar-traccar-1b8993293646', 'traccar-traccar-3b6900a95342', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-3642b9520863', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Correct: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'jhy-jsoup-8e2b86839b27', 'jhy-jsoup-9bb07d2ab43c', 'jhy-jsoup-195f484ba5de', 'jhy-jsoup-e52224fbfe66', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'jitterted-ensembler-14a39138787f', 'traccar-traccar-1b8993293646', 'traccar-traccar-3b6900a95342', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Same: 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-8e2b86839b27', 'jhy-jsoup-9bb07d2ab43c', 'jhy-jsoup-195f484ba5de', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
GPT-3.5-ChatRepair-0.8
Plausible: 'beanshell-beanshell-f345606a29bd', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'cloudsimplus-cloudsimplus-61c8b942d1ec', 'cloudsimplus-cloudsimplus-61c8b942d1ec', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'gradle-common-custom-user-data-gradle-plugin-982c77984b5e', 'jhy-jsoup-2a4a9cf83dea', 'jhy-jsoup-9bb07d2ab43c', 'jhy-jsoup-45ed00232722', 'jhy-jsoup-195f484ba5de', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'jitterted-ensembler-14a39138787f', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'stellar-java-stellar-sdk-15cc6d2c8131', 'traccar-traccar-3b6900a95342', 'traccar-traccar-4a5b8d79b560', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Correct: 'cloudsimplus-cloudsimplus-61c8b942d1ec', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'jhy-jsoup-2a4a9cf83dea', 'jhy-jsoup-9bb07d2ab43c', 'jhy-jsoup-45ed00232722', 'jhy-jsoup-195f484ba5de', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'jitterted-ensembler-14a39138787f', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Same: 'cloudsimplus-cloudsimplus-61c8b942d1ec', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'jhy-jsoup-9bb07d2ab43c', 'jhy-jsoup-45ed00232722', 'jhy-jsoup-195f484ba5de', 'jitterted-ensembler-0963194c9ebc', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
GPT-3.5-ChatRepair-1.0
Plausible: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'gradle-common-custom-user-data-gradle-plugin-982c77984b5e', 'jhy-jsoup-2a4a9cf83dea', 'jhy-jsoup-8e2b86839b27', 'jhy-jsoup-9bb07d2ab43c', 'jhy-jsoup-195f484ba5de', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'jitterted-ensembler-14a39138787f', 'mthmulders-mcs-eff905bef8d8', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'stellar-java-stellar-sdk-15cc6d2c8131', 'traccar-traccar-1b8993293646', 'traccar-traccar-3b6900a95342', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'traccar-traccar-3642b9520863', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Correct: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'fusesource-jansi-58260c6ce08c', 'jhy-jsoup-2a4a9cf83dea', 'jhy-jsoup-9bb07d2ab43c', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'jitterted-ensembler-14a39138787f', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3642b9520863', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Same: 'TheAlgorithms-Java-e5c7a08874a6', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-9bb07d2ab43c', 'jitterted-ensembler-0e512e5b3677', 'jitterted-ensembler-0963194c9ebc', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
GPT-3.5-MemPrompt-0
Plausible: 'cdimascio-dotenv-java-bbfbcfa63e3a', 'traccar-traccar-d244b4bc4999'
Correct: 'traccar-traccar-d244b4bc4999'
Same: 'traccar-traccar-d244b4bc4999'
GPT-3.5-MemPrompt-0.5
Plausible: 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-45ed00232722', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3642b9520863', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Correct: 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-45ed00232722', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Same: 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-1b8993293646', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
GPT-3.5-MemPrompt-0.8
Plausible: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-1b8993293646', 'traccar-traccar-3b6900a95342', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3642b9520863', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'xtremexp-UT4X-Converter-e719841eb260'
Correct: 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Same: 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-1b8993293646', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
GPT-3.5-MemPrompt-1.0
Plausible: 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3642b9520863', 'traccar-traccar-3331593759a2', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Correct: 'TheAlgorithms-Java-96c1a96647c9', 'TheAlgorithms-Java-a3a2d845d563', 'TheAlgorithms-Java-e5c7a08874a6', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-1b8993293646', 'traccar-traccar-5a1a8d9192ee', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3331593759a2', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
Same: 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-1b8993293646', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-3331593759a2', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99'
CodeLlama-ChatRepair-0
Plausible: 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-6f59f756a7d3', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'jitterted-ensembler-0963194c9ebc', 'crawler-commons-crawler-commons-2c2cb3bf7a95'
Correct: 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-6f59f756a7d3', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'jitterted-ensembler-0963194c9ebc', 'crawler-commons-crawler-commons-2c2cb3bf7a95'
Same: 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-6f59f756a7d3', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'jitterted-ensembler-0963194c9ebc', 'crawler-commons-crawler-commons-2c2cb3bf7a95'
CodeLlama-ChatRepair-0.5
Plausible: 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-d244b4bc4999', 'TheAlgorithms-Java-4f1514980495', 'jhy-jsoup-195f484ba5de', 'xtremexp-UT4X-Converter-e719841eb260', 'TheAlgorithms-Java-96c1a96647c9', 'fishercoder1534-Leetcode-2110c6b023b7', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'traccar-traccar-a9c311855a49', 'traccar-traccar-6f59f756a7d3', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-fdbd269b9b99', 'fusesource-jansi-58260c6ce08c', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-1b8993293646', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'jhy-jsoup-e52224fbfe66', 'TheAlgorithms-Java-e5c7a08874a6', 'mthmulders-mcs-eff905bef8d8'
Correct: 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-d244b4bc4999', 'TheAlgorithms-Java-4f1514980495', 'jhy-jsoup-195f484ba5de', 'TheAlgorithms-Java-96c1a96647c9', 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-a9c311855a49', 'traccar-traccar-6f59f756a7d3', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-fdbd269b9b99', 'fusesource-jansi-58260c6ce08c', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-230f629c3dce', 'jhy-jsoup-e52224fbfe66', 'TheAlgorithms-Java-e5c7a08874a6', 'mthmulders-mcs-eff905bef8d8'
Same: 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-a9c311855a49', 'traccar-traccar-6f59f756a7d3', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-6e5481ebb185'
CodeLlama-ChatRepair-0.8
Plausible: 'jitterted-ensembler-0963194c9ebc', 'jhy-jsoup-195f484ba5de', 'TheAlgorithms-Java-e5c7a08874a6', 'cloudsimplus-cloudsimplus-61c8b942d1ec', 'traccar-traccar-8de9a36abef8', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'mthmulders-mcs-eff905bef8d8', 'jitterted-ensembler-0e512e5b3677', 'fusesource-jansi-58260c6ce08c', 'traccar-traccar-5a1a8d9192ee', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-6e5481ebb185', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-6f59f756a7d3', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'jhy-jsoup-5f20fcc2f728', 'traccar-traccar-230f629c3dce', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-a9c311855a49', 'xtremexp-UT4X-Converter-e719841eb260'
Correct: 'jitterted-ensembler-0963194c9ebc', 'jhy-jsoup-195f484ba5de', 'TheAlgorithms-Java-e5c7a08874a6', 'traccar-traccar-8de9a36abef8', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'mthmulders-mcs-eff905bef8d8', 'jitterted-ensembler-0e512e5b3677', 'fusesource-jansi-58260c6ce08c', 'traccar-traccar-5a1a8d9192ee', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-6e5481ebb185', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-6f59f756a7d3', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'TheAlgorithms-Java-4f1514980495', 'TheAlgorithms-Java-96c1a96647c9', 'traccar-traccar-230f629c3dce', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-a9c311855a49'
Same: 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-8de9a36abef8', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'jitterted-ensembler-0e512e5b3677', 'traccar-traccar-5a1a8d9192ee', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-a9c311855a49'
CodeLlama-ChatRepair-1.0
Plausible: 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-fdbd269b9b99', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'jitterted-ensembler-0963194c9ebc', 'TheAlgorithms-Java-e5c7a08874a6', 'TheAlgorithms-Java-96c1a96647c9', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-230f629c3dce', 'TheAlgorithms-Java-4f1514980495', 'xtremexp-UT4X-Converter-e719841eb260', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-d244b4bc4999', 'fusesource-jansi-58260c6ce08c', 'traccar-traccar-3b6900a95342', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-a9c311855a49', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'traccar-traccar-3331593759a2', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'mthmulders-mcs-eff905bef8d8'
Correct: 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-fdbd269b9b99', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'jitterted-ensembler-0963194c9ebc', 'TheAlgorithms-Java-e5c7a08874a6', 'TheAlgorithms-Java-96c1a96647c9', 'traccar-traccar-230f629c3dce', 'TheAlgorithms-Java-4f1514980495', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-d244b4bc4999', 'fusesource-jansi-58260c6ce08c', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-a9c311855a49', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'traccar-traccar-3331593759a2', 'snowflakedb-snowflake-jdbc-f2c8eba73535', 'mthmulders-mcs-eff905bef8d8'
Same: 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-fdbd269b9b99', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'jitterted-ensembler-0963194c9ebc', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-d244b4bc4999', 'traccar-traccar-6e5481ebb185', 'traccar-traccar-a9c311855a49', 'traccar-traccar-3331593759a2', 'snowflakedb-snowflake-jdbc-f2c8eba73535'
CodeLlama-MemPrompt-0
Plausible: 'traccar-traccar-d244b4bc4999', 'crawler-commons-crawler-commons-2c2cb3bf7a95'
Correct: 'traccar-traccar-d244b4bc4999', 'crawler-commons-crawler-commons-2c2cb3bf7a95'
Same: 'traccar-traccar-d244b4bc4999', 'crawler-commons-crawler-commons-2c2cb3bf7a95'
CodeLlama-MemPrompt-0.5
Plausible: 'jhy-jsoup-9bb07d2ab43c', 'aws-aws-secretsmanager-jdbc-d25e52d637cf', 'fishercoder1534-Leetcode-2110c6b023b7', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'TheAlgorithms-Java-e5c7a08874a6', 'mthmulders-mcs-eff905bef8d8', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-3331593759a2', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-a9c311855a49', 'traccar-traccar-8de9a36abef8', 'xtremexp-UT4X-Converter-e719841eb260', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-d244b4bc4999'
Correct: 'fishercoder1534-Leetcode-2110c6b023b7', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'TheAlgorithms-Java-e5c7a08874a6', 'mthmulders-mcs-eff905bef8d8', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-3331593759a2', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-a9c311855a49', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-d244b4bc4999'
Same: 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-3331593759a2', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-a9c311855a49', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-d244b4bc4999'
CodeLlama-MemPrompt-0.8
Plausible: 'cdimascio-dotenv-java-bbfbcfa63e3a', 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-6f59f756a7d3', 'jhy-jsoup-9bb07d2ab43c', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3331593759a2', 'traccar-traccar-3642b9520863', 'TheAlgorithms-Java-e5c7a08874a6', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-d244b4bc4999', 'mthmulders-mcs-eff905bef8d8', 'stellar-java-stellar-sdk-15cc6d2c8131', 'xtremexp-UT4X-Converter-e719841eb260', 'traccar-traccar-a9c311855a49'
Correct: 'fishercoder1534-Leetcode-2110c6b023b7', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-3331593759a2', 'TheAlgorithms-Java-e5c7a08874a6', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-d244b4bc4999', 'mthmulders-mcs-eff905bef8d8', 'traccar-traccar-a9c311855a49'
Same: 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-3331593759a2', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-fdbd269b9b99', 'traccar-traccar-a9c311855a49'
CodeLlama-MemPrompt-1.0
Plausible: 'TheAlgorithms-Java-a3a2d845d563', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-7ce4fb9a628f', 'xtremexp-UT4X-Converter-e719841eb260', 'traccar-traccar-3b6900a95342', 'traccar-traccar-d244b4bc4999', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'cdimascio-dotenv-java-bbfbcfa63e3a', 'jhy-jsoup-9bb07d2ab43c', 'mthmulders-mcs-eff905bef8d8', 'traccar-traccar-fdbd269b9b99', 'TheAlgorithms-Java-e5c7a08874a6'
Correct: 'TheAlgorithms-Java-a3a2d845d563', 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-8de9a36abef8', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-d244b4bc4999', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'mthmulders-mcs-eff905bef8d8', 'traccar-traccar-fdbd269b9b99', 'TheAlgorithms-Java-e5c7a08874a6'
Same: 'traccar-traccar-6f59f756a7d3', 'traccar-traccar-3331593759a2', 'traccar-traccar-a9c311855a49', 'traccar-traccar-7ce4fb9a628f', 'traccar-traccar-d244b4bc4999', 'crawler-commons-crawler-commons-2c2cb3bf7a95', 'traccar-traccar-fdbd269b9b99'