Benchmark Summary

Platform: AMD EPYC 7763 64-Core Processor # 4Core

Sun, 17 Nov 2024 21:04:18 +0000

Project Comparison Benchmark

ProjectLangVersionType SupportBoolean
Expression		Comment
AllPartlyAST only
liberty-dbrustlatest✓✓current version
si2dr_libertyC1.0✓✓Synopsys's version at 2005, many attributes are not supported
OpenTimerC++172✓✓STA tool's liberty component
liberty-iorust0.0.4✓
libertyparserust0.3.0✓✓
liberty2jsonrust0.1.0✓

Parse Performance Comparison

liberty-dbsi2dr_libertyOpenTimerliberty-iolibertyparseliberty2jsonTest Case
144.22 µs61.90 ms129.28 µs140.69 µs250.66 µsFAILtech/freepdk45/gscl45nm.lib
4.34 ms190.72 ms3.60 ms3.67 ms6.51 msFAILtech/SAED32_EDK/nldm/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
281.24 ms2.82 s149.15 ms152.02 msFAILFAILtech/SAED32_EDK/nldm/saed32hvt_ff0p85v25c.lib
28.63 ms5.03 s16.55 ms21.04 ms42.34 msFAILtech/SAED32_EDK/ccs/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
11.48 ms5.16 s7.16 ms8.57 ms17.56 msFAILtech/SAED32_EDK/ccs/saed32hvt_pg_ff0p95v125c.lib
125.16 ms6.52 s81.19 ms78.20 ms168.59 msFAILtech/nangate/NangateOpenCellLibrary_typical.lib
7.78 ms8.46 s6.64 ms7.07 ms14.91 msFAILtech/ccsn.lib
174.05 µs9.16 s223.82 µsFAIL401.45 µsFAILtech/cases/formula.lib
160.71 µs9.15 s225.16 µs105.94 µsFAILFAILtech/cases/timing_type.lib
587.92 µs9.20 s718.20 µs630.07 µs1.31 msFAILtech/cases/ocv.lib
8.38 µs9.20 s1.56 µs2.39 µs16.78 µsFAILtech/cases/special_boolean_expression.lib
5.80 µs9.26 s2.93 µsFAIL9.37 µsFAILtech/cases/no_semicolon.lib
549.99 µs9.33 s569.55 µs474.12 µsFAILFAILtech/sky130/sky130_fd_sc_hs__bufinv_8__tt_1p80V_25C_ccsnoise.cell.lib

Write Performance Comparison

liberty-dbsi2dr_libertyOpenTimerliberty-iolibertyparseliberty2jsonTest Case
59.97 µs141.01 ms128.09 µsFAILFAILFAILtech/freepdk45/gscl45nm.lib
1.65 ms267.55 ms3.93 msFAILFAILFAILtech/SAED32_EDK/nldm/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
84.21 ms5.31 s83.96 msFAILFAILFAILtech/SAED32_EDK/nldm/saed32hvt_ff0p85v25c.lib
9.61 ms5.87 s66.21 µsFAILFAILFAILtech/SAED32_EDK/ccs/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
4.02 ms6.11 s37.49 µsFAILFAILFAILtech/SAED32_EDK/ccs/saed32hvt_pg_ff0p95v125c.lib
46.30 ms8.53 s37.31 msFAILFAILFAILtech/nangate/NangateOpenCellLibrary_typical.lib
4.40 ms8.72 s426.99 µsFAILFAILFAILtech/ccsn.lib
100.27 µs8.70 s33.79 µsFAILFAILFAILtech/cases/formula.lib
78.27 µs8.73 s131.40 µsFAILFAILFAILtech/cases/timing_type.lib
216.28 µs8.76 s300.71 µsFAILFAILFAILtech/cases/ocv.lib
2.86 µs8.75 s307.00 nsFAILFAILFAILtech/cases/special_boolean_expression.lib
3.17 µs8.84 s252.00 nsFAILFAILFAILtech/cases/no_semicolon.lib
341.29 µs8.81 s592.31 µsFAILFAILFAILtech/sky130/sky130_fd_sc_hs__bufinv_8__tt_1p80V_25C_ccsnoise.cell.lib

Self Regression

ProjectLangVersionType SupportBoolean
Expression		Comment
AllPartlyAST only
liberty-dbrustlatest✓✓current version
liberty-dbrust0.6.14✓✓published at 2024-11-07
liberty-dbrust0.5.9✓✓published at 2024-08-27
liberty-dbrust0.4.13✓✓published at 2024-08-13
liberty-dbrust0.3.1✓published at 2023-08-03

Parse Performance Comparison

latest0.6.140.5.90.4.130.3.1Test Case
151.08 µs152.51 µs166.25 µs159.99 µs199.87 µstech/freepdk45/gscl45nm.lib
4.16 ms4.32 ms4.61 ms4.57 ms5.71 mstech/SAED32_EDK/nldm/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
283.43 ms293.29 ms311.68 ms321.54 ms231.53 mstech/SAED32_EDK/nldm/saed32hvt_ff0p85v25c.lib
29.22 ms30.35 ms32.75 ms33.50 ms43.57 mstech/SAED32_EDK/ccs/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
11.55 ms12.06 ms13.90 ms14.51 ms18.73 mstech/SAED32_EDK/ccs/saed32hvt_pg_ff0p95v125c.lib
127.33 ms132.17 ms138.90 ms137.92 ms129.76 mstech/nangate/NangateOpenCellLibrary_typical.lib
7.83 ms8.19 ms12.37 ms12.24 msFAILtech/ccsn.lib
174.05 µs186.26 µs203.84 µs200.59 µsFAILtech/cases/formula.lib
158.07 µs163.58 µs175.15 µs255.23 µs243.18 µstech/cases/timing_type.lib
581.13 µs604.01 µs759.67 µs732.57 µs1.06 mstech/cases/ocv.lib
8.37 µs7.53 µs7.20 µs6.77 µsFAILtech/cases/special_boolean_expression.lib
5.77 µs5.51 µs4.94 µs4.56 µsFAILtech/cases/no_semicolon.lib
530.04 µs540.81 µs666.39 µs643.66 µs1.03 mstech/sky130/sky130_fd_sc_hs__bufinv_8__tt_1p80V_25C_ccsnoise.cell.lib

Write Performance Comparison

latest0.6.140.5.90.4.130.3.1Test Case
58.90 µs64.83 µs65.37 µs205.96 µs127.22 µstech/freepdk45/gscl45nm.lib
1.62 ms1.75 ms1.74 ms5.16 ms2.81 mstech/SAED32_EDK/nldm/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
84.55 ms92.59 ms87.88 ms194.47 ms109.45 mstech/SAED32_EDK/nldm/saed32hvt_ff0p85v25c.lib
10.00 ms10.80 ms10.28 ms13.34 ms12.24 mstech/SAED32_EDK/ccs/saed32hvt_dlvl_ff0p85v25c_i0p85v.lib
4.05 ms4.35 ms4.16 ms5.66 ms5.25 mstech/SAED32_EDK/ccs/saed32hvt_pg_ff0p95v125c.lib
46.57 ms51.40 ms49.26 ms116.86 ms52.04 mstech/nangate/NangateOpenCellLibrary_typical.lib
4.39 ms4.90 ms4.90 ms10.27 msFAILtech/ccsn.lib
101.72 µs112.63 µs114.04 µs264.36 µsFAILtech/cases/formula.lib
78.92 µs87.20 µs87.57 µs112.52 µs77.73 µstech/cases/timing_type.lib
219.45 µs247.16 µs254.65 µs707.22 µs366.71 µstech/cases/ocv.lib
2.95 µs2.86 µs2.84 µs12.83 µsFAILtech/cases/special_boolean_expression.lib
3.07 µs2.94 µs2.96 µs16.40 µsFAILtech/cases/no_semicolon.lib
339.90 µs379.40 µs383.68 µs712.67 µs313.20 µstech/sky130/sky130_fd_sc_hs__bufinv_8__tt_1p80V_25C_ccsnoise.cell.lib