You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
b614a45
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reactant.jl Benchmarks
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1351952654
ns1325006950
ns1.02
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1329740254
ns1235896790
ns1.08
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1313154586
ns1260870880
ns1.04
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
2566992420
ns2354818253
ns1.09
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Lux
221738431
ns208350792
ns1.06
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
5795183922
ns5855977297
ns0.99
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant
5365250430
ns5221394418
ns1.03
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
5580309503
ns5167730933
ns1.08
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
7018981334
ns7329557931
ns0.96
ViT base (256 x 256 x 3 x 32)/forward/CPU/Lux
32330341377
ns33799289512
ns0.96
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1295393361
ns1288968381
ns1.00
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1391655239.5
ns1367739710.5
ns1.02
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1288112883.5
ns1241844781
ns1.04
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2580913506
ns2383293970
ns1.08
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Lux
8622025
ns8825641
ns0.98
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1638985456
ns1947817634
ns0.84
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant
1598870688
ns1582676667
ns1.01
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1604887372
ns1587980197
ns1.01
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
2845843527
ns2835816387
ns1.00
ViT small (256 x 256 x 3 x 4)/forward/CPU/Lux
3290222049
ns3059951855
ns1.08
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1337995509
ns1383755457.5
ns0.97
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1266589678.5
ns1446515309
ns0.88
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1304533265
ns1261596782
ns1.03
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
2619821981
ns2589819311
ns1.01
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Lux
22673367
ns22684780
ns1.00
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
2164741585
ns2197648970
ns0.99
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant
2187101004
ns2228789213
ns0.98
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
2222453725
ns2201537016
ns1.01
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
3473087162
ns3498815180
ns0.99
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Lux
5922666949.5
ns5675046852
ns1.04
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1409824378
ns1286548945
ns1.10
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1274413695
ns1286795640
ns0.99
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1229630167.5
ns1307418594.5
ns0.94
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2435178422
ns2562260509
ns0.95
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Lux
6720828
ns7586742.5
ns0.89
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1443071529
ns1477416147
ns0.98
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant
1455478624
ns1459717161
ns1.00
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1436315353
ns1427023275
ns1.01
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
2698020568
ns2666201644
ns1.01
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Lux
1179865891
ns1191242722
ns0.99
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1311903715.5
ns1237383506.5
ns1.06
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1208899239.5
ns1281328564
ns0.94
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1315408397
ns1283366518
ns1.02
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
2622407972
ns2571097612
ns1.02
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Lux
12273085
ns12172844
ns1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
1747750553
ns1744895489
ns1.00
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant
1759657061
ns1744209257
ns1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
1730465781
ns1741523121
ns0.99
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
2979617791
ns2952374286
ns1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Lux
2985205457
ns3161120339.5
ns0.94
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1205936693
ns1246653286
ns0.97
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1289931712
ns1235082506.5
ns1.04
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1274603974.5
ns1256777245.5
ns1.01
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
2353800786
ns2464259574
ns0.96
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Lux
27361038
ns27204139
ns1.01
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
2245983275
ns2222730518
ns1.01
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant
2235719581
ns2224096501
ns1.01
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
2225764215
ns2192837165
ns1.02
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
3488656246
ns3433421300
ns1.02
ViT small (256 x 256 x 3 x 16)/forward/CPU/Lux
6519742812.5
ns5511062562
ns1.18
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1273072927
ns1275826558
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1275903559
ns1269696500.5
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1306679492
ns1268437005
ns1.03
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
2418323014
ns2335849488
ns1.04
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Lux
52729682
ns52614815
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
3106843960
ns3004532618
ns1.03
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant
3110765368
ns3029206535
ns1.03
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
3067530015
ns3106275502
ns0.99
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
4512690716
ns4523804192
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CPU/Lux
23082341445
ns13248514271
ns1.74
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1244033717
ns1287364685
ns0.97
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1220583584
ns1270728075
ns0.96
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1241043964.5
ns1211872705.5
ns1.02
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
2534565534
ns2307284213
ns1.10
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Lux
71029594
ns70823960.5
ns1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
3308971321
ns3242934004
ns1.02
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant
3272699344
ns3261225461
ns1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
3281133548
ns3276733542
ns1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
4663116034
ns4672103022
ns1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Lux
13237204037
ns12733986436
ns1.04
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1206105557
ns1198686032
ns1.01
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1205282113
ns1202407868
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1254093260
ns1268714295.5
ns0.99
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2518219292
ns2558419074
ns0.98
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Lux
20789324
ns20788095
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1913409296
ns1877899848
ns1.02
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant
1887591901
ns1956925868
ns0.96
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1917404653
ns2314364652
ns0.83
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
3181159514
ns3172070657
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Lux
3522016222.5
ns4073780422
ns0.86
This comment was automatically generated by workflow using github-action-benchmark.