Mutation tests on safety unit tests

[adeebshihadeh]

No description provided.

[mpetkovic96]

@adeebshihadeh Could you provide more information about this issue in general? Which part of the panda repository should be tested?

[maxime-desroches]

Currently using these mutations operators (others are not working correctly):

mutators: [cxx_increment, cxx_decrement, cxx_comparison, cxx_bitwise_assignment, cxx_bitwise, cxx_arithmetic_assignment, cxx_arithmetic]

See this page for a list of all the ops

Here are the current mutations that are not caught by the tests:
FAILURES_test_body.txt
FAILURES_test_chrysler.txt
FAILURES_test_defaults.txt
FAILURES_test_elm327.txt
FAILURES_test_ford.txt
FAILURES_test_gm.txt
FAILURES_test_honda.txt
FAILURES_test_hyundai.txt
FAILURES_test_hyundai_canfd.txt
FAILURES_test_mazda.txt
FAILURES_test_nissan.txt
FAILURES_test_subaru.txt
FAILURES_test_subaru_preglobal.txt
FAILURES_test_tesla.txt
FAILURES_test_toyota.txt
FAILURES_test_volkswagen_mqb.txt
FAILURES_test_volkswagen_pq.txt