IDA_flowchart tested on ida pro 9.1 with python 3.11

[lilian-lilifox]

IDA_flowchart

• cli_flowchart.py: Success
• Small unittest: Success
• Large unittest: Failed
  • DataFrame.iloc[:, 7] (column name="hashopcodes") values are different (26.15755 %)

❯ python3 cli_flowchart.py -i ../../IDBs/Dataset-Vulnerability -o flowchart_Dataset-Vulnerability.csv
[D] IDBs folder: ../../IDBs/Dataset-Vulnerability
[D] Output CSV: flowchart_Dataset-Vulnerability.csv

[D] Processing: ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x86.i64
[D] cmd: ['/home/lilian/ida-pro-9.1/idat', '-A', '-Lflowchart_log.txt', '-S/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/IDA_flowchart.py', '-Oflowchart:IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x86.i64:flowchart_Dataset-Vulnerability.csv', '../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x86.i64']
[D] ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x86.i64: success

[D] Processing: ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_NETGEAR_R7000_1.0.2h_arm32.i64
[D] cmd: ['/home/lilian/ida-pro-9.1/idat', '-A', '-Lflowchart_log.txt', '-S/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/IDA_flowchart.py', '-Oflowchart:IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_NETGEAR_R7000_1.0.2h_arm32.i64:flowchart_Dataset-Vulnerability.csv', '../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_NETGEAR_R7000_1.0.2h_arm32.i64']
[D] ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_NETGEAR_R7000_1.0.2h_arm32.i64: success

[D] Processing: ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x64.i64
[D] cmd: ['/home/lilian/ida-pro-9.1/idat', '-A', '-Lflowchart_log.txt', '-S/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/IDA_flowchart.py', '-Oflowchart:IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x64.i64:flowchart_Dataset-Vulnerability.csv', '../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x64.i64']
[D] ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_x64.i64: success

[D] Processing: ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_arm32.i64
[D] cmd: ['/home/lilian/ida-pro-9.1/idat', '-A', '-Lflowchart_log.txt', '-S/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/IDA_flowchart.py', '-Oflowchart:IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_arm32.i64:flowchart_Dataset-Vulnerability.csv', '../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_arm32.i64']
[D] ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_arm32.i64: success

[D] Processing: ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_mips32.i64
[D] cmd: ['/home/lilian/ida-pro-9.1/idat', '-A', '-Lflowchart_log.txt', '-S/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/IDA_flowchart.py', '-Oflowchart:IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_mips32.i64:flowchart_Dataset-Vulnerability.csv', '../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_mips32.i64']
[D] ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_openssl_1.0.2d_mips32.i64: success

[D] Processing: ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_TP-Link_Deco-M4_1.0.2d_mips32.i64
[D] cmd: ['/home/lilian/ida-pro-9.1/idat', '-A', '-Lflowchart_log.txt', '-S/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/IDA_flowchart.py', '-Oflowchart:IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_TP-Link_Deco-M4_1.0.2d_mips32.i64:flowchart_Dataset-Vulnerability.csv', '../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_TP-Link_Deco-M4_1.0.2d_mips32.i64']
[D] ../../IDBs/Dataset-Vulnerability/libcrypto.so.1.0.0_TP-Link_Deco-M4_1.0.2d_mips32.i64: success

# IDBs correctly processed: 6
# IDBs error: 0

❯ python3 -m unittest test_flowchart.py
.
----------------------------------------------------------------------
Ran 1 test in 0.395s

OK

❯ python3 -m unittest test_large_flowchart.py
F
======================================================================
FAIL: test_flowchart (test_large_flowchart.TestIDAFlowchart.test_flowchart)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/lilian/Desktop/binary_function_similarity/IDA_scripts/IDA_flowchart/test_large_flowchart.py", line 72, in test_flowchart
    assert_frame_equal(df_join, df_gt)
  File "/home/lilian/.pyenv/versions/3.11.12/lib/python3.11/site-packages/pandas/_testing/asserters.py", line 1279, in assert_frame_equal
    assert_series_equal(
  File "/home/lilian/.pyenv/versions/3.11.12/lib/python3.11/site-packages/pandas/_testing/asserters.py", line 1067, in assert_series_equal
    _testing.assert_almost_equal(
  File "testing.pyx", line 55, in pandas._libs.testing.assert_almost_equal
  File "testing.pyx", line 173, in pandas._libs.testing.assert_almost_equal
  File "/home/lilian/.pyenv/versions/3.11.12/lib/python3.11/site-packages/pandas/_testing/asserters.py", line 614, in raise_assert_detail
    raise AssertionError(msg)
AssertionError: DataFrame.iloc[:, 7] (column name="hashopcodes") are different

DataFrame.iloc[:, 7] (column name="hashopcodes") values are different (26.15755 %)
[index]: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, ...]
[left]:  [653fdfc1e55f362d1293312fb96892f7a5606f5a5dc7066ecf54950822f347c8, c099dcf506adb4743e9425b0595bb1068cb49839e387bf85298eb4416ad92e9e, 52804e45d2dd7dff63125efab3e388aef3099c07b564b599677bbda6a70bc5e4, 23601bae905f07dd4cde9b074a42264a641491445aac12b9fdd3f71301406425, 603561568fc30c556641ddc663ee250b346ad50ad9c36bcabf83e3f204a1a46c, c2340a0191b5d2b3f4029c7e0a50e7f228f7dd31c5f2156cc97baf8ea6c38663, 0806c271b233d470a6297f8551546e5785cd874459ad376ceb800eac65299e54, 23a86391a4497e9a33a67c20b05fa83544991bfcf862ddd7f6fa5a7a49d6520f, db4a178e3fd62ee2f9947c2f388b44ff2cfe8ffbf29e60ad7b3c9e56e64471ff, d6103ff924be8215209f561a8de288a9b867e90df2595e12e5fe59134e697f8f, c52379430df13e734fb603059fbc58355cedc7a31db2906162ce97c3639d2faa, c4caea3921a8a2d4a6483222a4caf68a028f68ce22fdf3e345918f1d0e0d3db6, abcecbc57227bb060265a9a22f7ef787d70820d2c2ca173362504d326ed7d4a4, 898abfaec85ede277254f15d95a6f5c0a50e0c8f2dfe062bb0be1a946318d504, 191ff6ea93ed654c24c509ca711aa9ceb9ac5a6a8750fac1ace79d221c4e2f4c, 4bb5b9f50761bad3ac35a0e20cfc09e2b762a704de6b6b1d62450d5be09bdee9, 4626bd7a63e97767f2e5f5f62f3e976036a93382f8eed4dd4e2aa69ca00233a0, acec6db9bb8e3247693f3c9c2ac17a1c98fc698d2593cb940baacc345bcc7796, 3558d25498b1389ee0ec27e815364c7800344290b79818cba20ed05841a1b266, cb8385f08a3dae4fa545e35675219e9279e42ee4f114290ae196c99ae634aeac, ccabaf0a777868ba975d114b434aa61a98ae92078127c7f0643b737399846be1, 307ef6d1e8863001d5da1c92347722cf236568858be94aaffcfe72a97de47424, fb212721855fabf1892f833089a7ba2d1059737114a51edcc9b70a429b0b5258, 128b268e85cc0ad8a85d602328c611fef19743ba9980352960ef79b4d7006db4, 5a184bfd102d4741a8e698b2f800e2728ad8b5f2e87aa41adaf788090f715793, 8ca399f88158a6d58946089f6804cf0a57eebd81c0237d00c2cf77411ff27250, 9f8d551d89b8ee80105b38bdea5a082999847612358188c3848f394d1e2d2c68, 71c39e777415cbffc84c88a36932cbc4f65799a3b6b28bb1da7deb30f5c1a9f7, 17c3b236591e9925ffafa93d387bc11bb5e6a5292ca2c10b7c4b35f3e1482f11, 206cd8b85e37df86419ae935698cb666a5dcc85304cc8ab8bc53892ad963d11c, 2308393c2546cb6f3858ecc0aed671413d6b79b55dd7807fe60e8eb3149efe43, 17ec28fbd8cba709aadc06e9a70f67fe649c9e0bc76fca5874679ba26e6a6492, b5cea7cd13f16230015cf875c1a57a64d2572215e2be1fa14074fee543c01147, da99094b95f9eae330becb1d0e070a543c1d70c740167e5fb0969a7b1473de47, 390ae23856efb532289d7d2c24ce9b3f3c4b7c64c34a2b662d2729a2b5859237, f3b1c3f606e2fc150ad7bae1660a1bb12724b91d3235c5978166a9830e4c99fd, 0c654f72da876119c8c218ba552b5c45b401d574f7297331d5891337751d4594, 702dd682709ee4efbfe141df626635dcd3bff8074c75cf218c52d43beb0318bd, 9581e2d24caa9c409ff61dfa0c240f3f65f2ba2861d2bf78a6577950c6041e51, e4069de3dc18b8a98048ec057bd96a7afa38b99bca93cb2aea238eb6a4525767, 5093a5c6ba1ac3e70dd488ca297bc5b281b0ecfa3c724dc29c934483455de019, 9f070eecc9870cafeed18febe50ef8598f3124b8c13dc747dff0a71b9b3895b8, 744761b992583d370f3967fd29c1d1282e7725cbf5d375583cc4ab287198d01b, 202970e38795764964eb0acb6df3a836eeccf4e83e0e7fde92817e5991af1021, 6f7402265aede1d133869b7010ebd92dd06892184ee9939d92348f650dc851ef, 8034ea7f3a07ecf501c2311acd572cc49ec4f9328d0585f971d207ae1fae4fb1, d95cb7fdfbeff3c88781e667e1fa8a60039314b802238a5c5d550ca88c9056f1, 643a0e07a07a05352b94d5cdb260228bf55cafcb08efef88b51684f318c4eaeb, 48d106dd92cf7f5754fcef0a2ef428148caca9fa0601a8831f9dd9e6129e8189, 882561e8106b6c7ae329afb456e9af9f84d053e49100b3b4530edf34472cb7b3, 077988828b397b11298ef57a6b7dba2022be48c326297e2b6db6b650692dff99, 66df89561648aa7ed75f1ac616a3b59d619d2d459f4f70c1bd536c3973f2cdb5, aae577ba9a693f699f24a8114a1a3b2e93d255faf131075ef38f444fd51396dd, 0fb09387358cb55a5c5c2088494d5a45af7c15418b50f496b5ec7eb969293373, 8a9b795cc1c3fcad38ecd2e52c123ab49c444d17a5711debbeb90a789810e0e7, f25c8941110cceb1d117aa584a7848474dd73f33d0558de62803974b4a3301a2, 882561e8106b6c7ae329afb456e9af9f84d053e49100b3b4530edf34472cb7b3, 5f94580f70d1536ba22f4b31712cd03e56c0a1bd771b007c11693a293adbd50a, b3cb90060db7e8ca22c51be250d1e0af7c5adf607d8e2133a09e6505bc4f7298, 7e582886e2772378d12098689efc11cfaebe06dbe6eae928cfb395984898aae8, 51e0e6e8d94f600a086f14e0f39814aed1bf6aaa7b3d92841153a08a1aa3c1a8, e4ed66f8d8edd07d58701be7b9aa67fd95f3f3632d09255a5f350e238446c3ff, 1833178f387a854c1872f8557c0cbe8698582089c57ef427ed62f5f4493619d5, a0060df15f1bc34e29440528694bb7d5e6b8a299324dc5ecb386e64df6a8c7e7, f55cf50ca6f742960392f47a199cf028765b5410b20c3118d833c74adbc8d195, 7c4f18ea74e7da33319bff1b5744b3015c58920a0a3185f2e0f8523b73775228, 4d2ca75da3924c38b1a6aed09668055175dd296b00f684124cf898a0bea63f24, 348029458e7b15201ff4d2f13c847d67c1d81f4385442ba56f063fa0480469b8, 348029458e7b15201ff4d2f13c847d67c1d81f4385442ba56f063fa0480469b8, 882561e8106b6c7ae329afb456e9af9f84d053e49100b3b4530edf34472cb7b3, 4d2ca75da3924c38b1a6aed09668055175dd296b00f684124cf898a0bea63f24, 882561e8106b6c7ae329afb456e9af9f84d053e49100b3b4530edf34472cb7b3, 96e06133253b0605820fb580b7db578df96a2d970e41cab151e4920259c9ea39, ffbf0f8ef584160f03477868a5d389b44cc992dbaa9c51392017a77ba304ba25, daf03b6232b9be406d0081cb429a1b6273074dbc8cf55e2b2cce0d84362d40f6, 36ceaa39a745e6cc0aea0e514154a319626c9ddaac2c34710d5d403da5e562f4, e001296ab0d59805ee2f6a3cd64e20f207ef578e31d093c486394da22881ca4e, 8390154cec468e054eafaf3faa0ce84a65c32b8330809a1f9e7a3785b6f77f09, 4d2ca75da3924c38b1a6aed09668055175dd296b00f684124cf898a0bea63f24, 882561e8106b6c7ae329afb456e9af9f84d053e49100b3b4530edf34472cb7b3, c94d866b16a9801c52f6252d6f4e2202cc571935a5ba072c46fa6b9620c745a5, e24c243abf92d1ded30fe416ac13b101857adfc9b7613e1fe37049f88819c719, 2bb00b879c37985ba1f3055c3b7479c359d7af38075c0c23fb005ca07e9145ac, 4d2ca75da3924c38b1a6aed09668055175dd296b00f684124cf898a0bea63f24, e2ae5ee169545035c641d60b8838583bb93b55ca40208f80d5bbadbf837833ca, 95010080dda630a609705e9d470efac05a05159128f89edbc79ee30ce8998f96, 56be51f4bf26cb84f2cc0f898842b4cdbdf199bb98a695bb184845d7bbc33cc3, d872a18f1fab53dd59947f25bea4919b228a217d22ddc5342296bf9802f08123, a9d8d8b462fb753333ef1fd484efc1b7b6d273d48f64c70cd734df876885e84c, ffe60d0f75b4a9f8016d03cc03d63b1b37b7b72175e9b4ce94ff2ebd91a1c899, 2bd20d32feca5b550cc6f23d213f9dc102be6466c0d2dc615c24a4f7818a540d, 2e4df3a64096ddf2cf7782f9c2f17c86c073aa3a1990208ce8a0f4a206ef3480, 2e4df3a64096ddf2cf7782f9c2f17c86c073aa3a1990208ce8a0f4a206ef3480, 054df37ded7ba3521bb79d055843aef89d967c25b44497412e404cdb4c690ca5, c5e1f2fe2eab721a1e889f8ad67a2f30eb2dadb2019677fdbe5f5f931eaa6b57, 3297cbe6f282e47e7b086ce923e76b3f34a247f1157f3be73d1e022fba1daa6b, 893f493932e2d783d47389158b6cabc93f4a85ab7ac9f1175937e916f26ca50e, 1eb6e1615a33d748b8b0993aeac561a6a6dbe77892502963a3295cc74459bf7e, b3660f69cf99dd91227ce12639e353de4e5003b6887e65b2a093da01d94f4b66, bcf378638bcd7c3c47bac594296e853e18bbab9edfe0b526a3b25038d4d77fa7, ...]
[right]: [9cd6c154aff2436ff74bcb0f6d8cc4ff329a4d3ef5127870519a3e2a1d5a12f9, 32f9a9ecfb890ec07a7b760ce2de56eb5eb7f1dfd1883faeb33690f085828256, 52804e45d2dd7dff63125efab3e388aef3099c07b564b599677bbda6a70bc5e4, 2e7a4c5d499dcb0961766e3ae45e88a98876b3890f9639f1b948782c40d2f160, 5fa378758f07064de3f4bdde41df1e30330a084d3532948d29f39650fd44b8d9, 4326b31b51328b86a93b70cac2103d2b41f8281d2a77d0dc953241293108b402, 13b4e8a8689593f039bfe15bd6e14359bac403aeecec6621965c43fc384c6b46, 23a86391a4497e9a33a67c20b05fa83544991bfcf862ddd7f6fa5a7a49d6520f, 0aef5f5bb1628437e13483b697a2089307fac5835248669c133c523341d5f2c4, 98ef981adb227e57b04c456a038a6ef493c027af69ee4888f98b46c6693b4e3f, 7afce785827dbf327a7dda80a5b31dd7f2cd201827bcfe7a277ecefd495b2f9f, efc11e77fe397bb980c7c1a9aea4d86d3a68edc4e14566dfc01f125de99581b6, abcecbc57227bb060265a9a22f7ef787d70820d2c2ca173362504d326ed7d4a4, 4c7a53f5f44dbf0604860ff89bade157a5d80c395bb204524f72c49e2749eed5, 120d31eff5fd7d70d2f2936a6998626e45f6d9e2fe99451a3002c3a26546733e, 7b5314665d97ae3ef574fb46ef1efa8e475904e27fc44f6cf3ba4c9e1c6aec7e, c99552c12d05c867286bd8e9bcce7ccc2ad1598f3a5794640784faaeaec07f51, ac9812f1009b750baa7e6e7ede5bae592ada1b838232cc6e8ed65c024ddb3ca4, 91385a198e8ee5815b82fa14ebda29940c27af47c5a7ff9dc771cad09b320631, 0519ea80e0374d39266f667b04ed052945bb3075bb020e3ad90c0028230aeeb9, f90962f558360f8defbe4c699ff729a184e71a60bcdf3e6e1ba0104183cc4d40, 9c5b0e54d438c65770c656f4a024ae8f77630cd75ff7935bafc6bbd8bffb3d9e, 2e82ae2d22b9cc017a64e81b12136d8df346aa5c5c36c13316389bac62b183ad, d9fc7dd3ef0e9e2ceee824731c4510cf9b4b5c1790ee744b26f250f046e17c7b, 0abbb740c45ce71ffc942b091d594489cb01106db2d85c90b4411d35c58478a9, 4f01bf89abed41f40f8af295c83f48505c7768cd9e29e10bca1928c5d036eeb3, 9f8d551d89b8ee80105b38bdea5a082999847612358188c3848f394d1e2d2c68, 11236aa3316b71bb98a0c1c72a66f5d21f2058827e469d87dcde9cef3db0f882, 2e9d1af980eefdee77024445cc9db6c0b2f4845e691e5ffab1bf72e99222bff6, c2f07c028489575e35b0409280d0eb5b38c92f4c13c0c0f0967e806043e04593, 15674781a95524510815996fd3e1a16aa25612e325476c9079dde7994f9262c8, f8e09881b170077961ec98d23f02fea979be5b729c2691119b831638d19f8aae, 0d1cace9eb202d9be0c76948e4dc4d1ccae7cb28d63d744f1e9378cb17b3e977, 0d0bfe27a7c33e73a99630170f87b5bb6c10f3d5ba2e1e972a7d312abc949ac6, 9272823d5eae0c22ce95a9bcdf4eac8fe3435f2984b481ea642097f311f4cdcc, e79233ce7ef53eb81790a710e47f3421ddc1b321be8d1c4cec371033efe4afc2, ce92138a67a93a4946b2364e86ec67d934812346204b29f39ea2bf60bcb56161, cb4f8d117488bb0a8d3c737d566c7f4e15d6071004d4c174f3ac6f3ea3129c01, f352d3e22f0ba31b99b28a5a0e17cf0638982dd5dfff2eb7a16fdd3e0fc06b20, e4f31a193ddc829fedca0c4710c5b66d8821c0290c5f3abb41f2792d44a82073, 5b1e6c88c138c8495746e5619bd11b064656109b82dcd757f4fb2e12b892bf4b, 85d68e8dc39662912960f1a5f18f61d362b73c0d0895cce74797de5bb1d96b7e, 7a5fc37c43b8c323f20c6e7c821832c5a21f979d09b05b5fb395737d3fba7ebf, 7ff8b7e30a42689015c6f9545befe39b44ddb2ef79f17e7c9633aa307164427f, c808183127b5ad14b56cd8f85d7168ca9a1e76cbabeea5ad694f0b5d9221809d, 49133c5a1a313149470ea3e835b9011abc1c8779527090d67b5dcbde5e964f99, eb4da854fbffc216b330f53de6b568b411727c909d0bdb0e45a0d09ac43ceb0b, 7ec4ecc48d01193f7e0064be299c1b04290f0136fcadd0ccad66c900b41acab4, 0bb62ac7943c5f150e960a01a0262c71ada3f3278ca5414e7d41a30e65050f6e, cb1499d7817df540da61fa4c0907ce7b20250bbf8e026fd780128e8a47332610, 1575c080627d21c385b5a0cb2c57c159819ab8c748b8520b31aa82d41cbec767, a4fefd85f46b527bc89725c11697ef5cdf1df91272b99ce286ed547cbef03e6a, 2b7ef986695fe39dcf74e9bcd1d73ecdad451929a40afdcfc987735f5b407df1, ca622e58889c8d37969585da3f5d6a9c2bb1d72ebbcc49e0634cc8783f259f7f, 86ec06afc82bcaf6c1a821373238af77de90a91e702ac75293a3d2f21fc5a13f, 4097b784e4f5fba314bea6a008cd822b3784509b3bdc31e74b8e3891b48fd6c7, cb1499d7817df540da61fa4c0907ce7b20250bbf8e026fd780128e8a47332610, 91ee8c9cb5edd713b413308e44cc87b7f7b7011423f071e59d7c8329e1540b4d, 8d08ccae9b96becc762125bdf9b1a872aa3c0d66e0e36552867c8a05a0d7c289, f65216302de69cce1d1c89e3f8fe6bd1cf5d429bbf72e8414c9e0562be735389, 7b4b9f8db07467d8957ac84effc5e72d2b0a6391e379700258c9bf0c3f0fdb17, 586df72238fc534c8383791ebfeda790c636cdfa7417fa24e2963b4605faf353, bbacf4768695d7305d47d5d40dd1c84917bd87a3fd63ce8ebc05a35240ec6675, 3c8838871477c65ceba4b973260c506627bbd80e239db98380e5ccdcfb096b0f, ea65da36c0380dfdd0db1b631f6be94591a55ba5e98821edb1f1d700ef844f00, 8cfd62cba1d29cbb7a812952aa590be7f76428250be86048514841d8562257dd, b13f3dee98e5b28e84d003350700628f26342517c7b5a3e344be38e289c2ad9f, e6b8b0f04adb104cb2b7d0315572c162450c138e725438a9e3b8b2e6a3404381, e6b8b0f04adb104cb2b7d0315572c162450c138e725438a9e3b8b2e6a3404381, cb1499d7817df540da61fa4c0907ce7b20250bbf8e026fd780128e8a47332610, b13f3dee98e5b28e84d003350700628f26342517c7b5a3e344be38e289c2ad9f, cb1499d7817df540da61fa4c0907ce7b20250bbf8e026fd780128e8a47332610, 67219c026fb05dfd1175b9960821ac87473a3ffc65303bbf7e467f66449f3e7a, ea5042efa31efc3777fdc390ed720cb20042d872e65d2152360df3b31454964a, b121ecac3bc49cb005c4f3264578f5dfb76bfc9c67e7e566b6b06d3c9bd4dd41, 23b2939697f8d9ee66ebd0bf327628a24a7391efd4e46bfda4dc13e45209c03f, fcd96f1c1cd0cf2e6cf811254f56599126a130921d6bbc4610078c6fd50c745d, 82ec0577bcbbd88fbbdc60d370265752c62c66d741ec236aff4d5ee412e8cfb4, b13f3dee98e5b28e84d003350700628f26342517c7b5a3e344be38e289c2ad9f, cb1499d7817df540da61fa4c0907ce7b20250bbf8e026fd780128e8a47332610, acd78fa6dcd0514d5594269b42df4545937aee38585ad50ef36dbd145b07b531, 440873209a3727f0581907bdf13b5e66708431403a35084f686492a143b79f95, df1ec124af416f582b49fefa7070b22c8e603183c37983b30854f50c082a2ff1, b13f3dee98e5b28e84d003350700628f26342517c7b5a3e344be38e289c2ad9f, b4a2a66d7286fa895a724a41386e5b6e0394dbb4b292c5e3c6b7af0fa0b693f8, 86721a89b763705c8fe0bc237d01eb9f52efa62cdaa3c50e086771df5d3d3303, 00a89741b1e568b9d7d21ee6c6c961ee34918a6f08b90f9419ebcb10a6597e10, 3a9acd71e39ed7c9962853a99d1ea36df31f599614fb7f0271bb67a1fae1f5a7, aeffd1291ed0608f1120b5bda636da49b81e569e802c9cb7612ca7f2ecfba8b7, 433fcb111dbb626ba59870d1dd2280e92b7a8cf07f9c003b521b08884342db67, c848bb5eb78400debf3086684582bde67d781706935aa48339a43856b559879d, 2c8b1443491b1bfcfb8ddbb9434b9221127c7bbbe9d1663cd74558856483dedb, 2c8b1443491b1bfcfb8ddbb9434b9221127c7bbbe9d1663cd74558856483dedb, 1ac4cdd2f68a66cbaccb71a8f2bc018549b70814d830709d083e3267b4d44974, 6408e12df5b33e35142392a5752bb899b4eca3722b26484eee8755df89bc5d92, 8b98c8d64dfd3c52fca96f7584aeaef88f7beade8f6ae6fa4f9d1a40f27417ba, 4b1d84e3ab9ccc5ac86362a8f5c427f78aa1f198a5dd7b070fa1e99377937efd, 3a21e3ec35084b504cf71b545fbc736938584e7c5e8e4cd2ec4a7087f713099b, dcff00de81976b8faeab08c321a83d66588db1a475958090df8878f5f2d5c889, 2db099c6c717a8b94edf8f97a93239d5d569c180c5632cffb29e5e78afa1aadd, ...]
At positional index 0, first diff: 653fdfc1e55f362d1293312fb96892f7a5606f5a5dc7066ecf54950822f347c8 != 9cd6c154aff2436ff74bcb0f6d8cc4ff329a4d3ef5127870519a3e2a1d5a12f9

----------------------------------------------------------------------
Ran 1 test in 8.372s

FAILED (failures=1)