基准测试结果¶
备注
我们将继续更新以下基准结果。如果您提出了新的(经典或数据驱动的)OLPS 模型,可以通过 联系我们 发送您的论文/代码链接给我们,或者提交拉取请求。我们会尽快将其添加到这个仓库并更新排行榜。
盈利能力的基准结果¶
参见
有关盈利能力的基准结果及其分析可在论文中找到。
风险抵御能力的基准结果¶
除了盈利能力的基准结果,我们还进一步评估了 2 个重要的风险指标:波动风险(VR)和最大回撤(MDD),如 FinOL 所示。下表揭示了:
不同 OLPS 方法的风险特征差异显著。像 SSPO 和 PPT 这样的方法由于其激进的投注行为表现出更高的波动性。相反,像 UP 和 ANTI 这样的方法则产生较低的风险。
对于模式匹配方法,AICTR 和 KTPT 承担了更多的风险敞口以追求更高的回报。
大多数元学习方法表现出与基准相当的中等风险特征。这验证了它们通过结合多种子方法在回报与风险之间平衡的能力。
模型 |
NYSE(O) |
NYSE(N) |
DJIA |
SP500 |
TSE |
SSE |
HSI |
CMEG |
CRYPTO |
|||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
VR |
MDD |
VR |
MDD |
VR |
MDD |
VR |
MDD |
VR |
MDD |
VR |
MDD |
VR |
MDD |
VR |
MDD |
VR |
MDD |
|
Classic OLPS: Benchmark baseline |
||||||||||||||||||
Market |
0.15 |
0.21 |
0.26 |
0.55 |
0.28 |
0.18 |
0.23 |
0.28 |
0.17 |
0.26 |
0.18 |
0.29 |
0.18 |
0.36 |
0.16 |
0.24 |
0.41 |
0.36 |
Best |
0.19 |
0.17 |
1.01 |
0.96 |
0.45 |
0.15 |
0.48 |
0.16 |
0.55 |
0.38 |
0.49 |
0.35 |
0.53 |
0.60 |
0.45 |
0.52 |
0.54 |
0.36 |
UCRP |
0.15 |
0.20 |
0.27 |
0.54 |
0.28 |
0.18 |
0.24 |
0.29 |
0.17 |
0.26 |
0.17 |
0.23 |
0.18 |
0.36 |
0.13 |
0.15 |
0.40 |
0.34 |
BCRP |
0.18 |
0.15 |
0.66 |
0.77 |
0.44 |
0.16 |
0.45 |
0.17 |
0.55 |
0.38 |
0.49 |
0.35 |
0.34 |
0.37 |
0.45 |
0.51 |
0.50 |
0.30 |
Classic OLPS: Follow-the-winner |
||||||||||||||||||
UP |
0.15 |
0.20 |
0.27 |
0.54 |
0.28 |
0.18 |
0.24 |
0.29 |
0.17 |
0.26 |
0.17 |
0.23 |
0.18 |
0.36 |
0.13 |
0.15 |
0.40 |
0.34 |
EG |
0.15 |
0.20 |
0.27 |
0.54 |
0.28 |
0.18 |
0.24 |
0.29 |
0.17 |
0.26 |
0.17 |
0.23 |
0.18 |
0.36 |
0.13 |
0.15 |
0.40 |
0.34 |
SCRP |
0.27 |
0.58 |
0.72 |
0.92 |
0.38 |
0.23 |
0.47 |
0.40 |
0.56 |
0.70 |
0.48 |
0.64 |
0.55 |
0.63 |
0.52 |
0.70 |
1.04 |
0.89 |
PPT |
0.36 |
0.39 |
1.04 |
0.84 |
0.44 |
0.12 |
1.55 |
0.60 |
0.94 |
0.22 |
0.41 |
0.53 |
0.77 |
0.77 |
0.49 |
0.61 |
0.92 |
0.85 |
SSPO |
0.36 |
0.39 |
0.92 |
0.85 |
0.44 |
0.12 |
1.52 |
0.60 |
0.95 |
0.23 |
0.42 |
0.57 |
0.78 |
0.75 |
0.52 |
0.68 |
0.92 |
0.85 |
Classic OLPS: Follow-the-loser |
||||||||||||||||||
ANTI1 |
0.21 |
0.20 |
0.60 |
0.62 |
0.31 |
0.20 |
0.74 |
0.31 |
0.45 |
0.17 |
0.24 |
0.24 |
0.49 |
0.65 |
0.28 |
0.37 |
0.43 |
0.28 |
ANTI2 |
0.24 |
0.21 |
0.70 |
0.62 |
0.34 |
0.20 |
0.90 |
0.42 |
0.59 |
0.16 |
0.26 |
0.23 |
0.62 |
0.72 |
0.33 |
0.46 |
0.44 |
0.25 |
PAMR |
0.31 |
0.70 |
0.58 |
0.58 |
0.40 |
0.19 |
0.78 |
0.48 |
0.66 |
0.25 |
0.32 |
0.56 |
0.46 |
0.69 |
0.36 |
0.52 |
0.70 |
0.86 |
CWMR-Var |
0.31 |
0.70 |
0.62 |
0.65 |
0.40 |
0.19 |
0.85 |
0.49 |
0.66 |
0.26 |
0.31 |
0.56 |
0.47 |
0.72 |
0.37 |
0.51 |
0.67 |
0.79 |
CWMR-Stdev |
0.31 |
0.70 |
0.63 |
0.67 |
0.40 |
0.19 |
0.85 |
0.49 |
0.66 |
0.26 |
0.31 |
0.56 |
0.47 |
0.72 |
0.37 |
0.51 |
0.67 |
0.79 |
OLMAR-S |
0.35 |
0.46 |
0.94 |
0.85 |
0.46 |
0.16 |
1.17 |
0.71 |
0.71 |
0.20 |
0.41 |
0.58 |
0.54 |
0.81 |
0.46 |
0.60 |
0.83 |
0.75 |
OLMAR-E |
0.35 |
0.64 |
1.00 |
0.86 |
0.46 |
0.23 |
1.24 |
0.85 |
0.75 |
0.28 |
0.41 |
0.67 |
0.55 |
0.81 |
0.44 |
0.64 |
0.72 |
0.89 |
RMR |
0.35 |
0.54 |
0.90 |
0.84 |
0.46 |
0.21 |
1.16 |
0.76 |
0.72 |
0.19 |
0.40 |
0.55 |
0.56 |
0.79 |
0.44 |
0.57 |
0.82 |
0.74 |
RPRT |
0.35 |
0.60 |
1.08 |
0.87 |
0.47 |
0.29 |
1.65 |
0.80 |
0.95 |
0.30 |
0.44 |
0.58 |
0.56 |
0.76 |
0.47 |
0.59 |
0.72 |
0.89 |
Classic OLPS: Pattern-matching |
||||||||||||||||||
AICTR |
0.36 |
0.52 |
1.05 |
0.93 |
0.47 |
0.20 |
1.35 |
0.75 |
0.93 |
0.31 |
0.45 |
0.71 |
0.56 |
0.79 |
0.46 |
0.62 |
0.90 |
0.65 |
KTPT |
0.36 |
0.64 |
0.98 |
0.68 |
0.43 |
0.12 |
1.32 |
0.64 |
0.88 |
0.24 |
0.38 |
0.68 |
0.58 |
0.78 |
0.50 |
0.73 |
0.79 |
0.94 |
Classic OLPS: Meta-learning |
||||||||||||||||||
SP |
0.15 |
0.20 |
0.27 |
0.54 |
0.28 |
0.18 |
0.24 |
0.29 |
0.17 |
0.26 |
0.17 |
0.23 |
0.18 |
0.36 |
0.13 |
0.15 |
0.40 |
0.34 |
ONS |
0.19 |
0.24 |
0.77 |
0.89 |
0.36 |
0.23 |
1.22 |
0.72 |
0.37 |
0.28 |
0.21 |
0.24 |
0.60 |
0.71 |
0.07 |
0.14 |
0.43 |
0.31 |
GRW |
0.15 |
0.20 |
0.26 |
0.52 |
0.27 |
0.15 |
0.28 |
0.27 |
0.31 |
0.34 |
0.22 |
0.27 |
0.20 |
0.37 |
0.15 |
0.15 |
0.42 |
0.46 |
WAAS |
0.15 |
0.20 |
0.27 |
0.54 |
0.28 |
0.18 |
0.24 |
0.29 |
0.17 |
0.26 |
0.17 |
0.23 |
0.18 |
0.35 |
0.13 |
0.16 |
0.40 |
0.34 |
CW-OGD |
0.15 |
0.21 |
0.37 |
0.66 |
0.24 |
0.16 |
0.26 |
0.37 |
0.21 |
0.25 |
0.24 |
0.33 |
0.23 |
0.37 |
0.24 |
0.29 |
0.42 |
0.34 |
分析表明,尽管某些 OLPS 方法可以获得更高的盈利能力,但其提升通常伴随着更大的风险敞口。因此,理想的 OLPS 方法应该在控制下行风险的同时最大化回报。基准结果激励了在数据驱动的 OLPS 领域开发创新机制来管理风险,如自适应仓位调整、稳健的再平衡规则和风险敏感的损失函数。
实用性的基准结果¶
我们还考察了 2 个实用的 OLPS 指标:平均换手率(ATO)和运行时间(RT)。下表展示了 FinOL 上的 ATO 结果。可以总结出几个关键观察:
像 UP 和 EG 这样的方法通过稳定的再平衡生成相对较低的 ATO。
然而,一些属于跟随失败者分类的方法(例如 CWMR 和 OLMAR)由于频繁调整投资组合而表现出高 ATO,这可能引发关于高交易成本的实际担忧。
大多数元学习方法的 ATO 水平与 UP 相当,低于换手率更高的 PAMR 方法。这表明元学习方法能够有效平衡适应性和交易频率。
模型 |
NYSE(O) |
NYSE(N) |
DJIA |
SP500 |
TSE |
SSE |
HSI |
CMEG |
CRYPTO |
|---|---|---|---|---|---|---|---|---|---|
Classic OLPS: Benchmark baseline |
|||||||||
Market |
– |
– |
– |
– |
– |
– |
– |
– |
– |
Best |
– |
– |
– |
– |
– |
– |
– |
– |
– |
UCRP |
0.57% |
0.75% |
1.24% |
1.01% |
1.06% |
1.98% |
1.94% |
1.52% |
0.96% |
BCRP |
0.20% |
1.15% |
0.70% |
0.41% |
0.30% |
0.37% |
2.59% |
0.44% |
1.15% |
Classic OLPS: Follow-the-winner |
|||||||||
UP |
1.37% |
0.75% |
1.97% |
1.01% |
2.02% |
2.50% |
2.66% |
2.10% |
1.88% |
EG |
0.55% |
0.71% |
1.20% |
0.96% |
1.02% |
1.90% |
1.86% |
1.47% |
0.92% |
SCRP |
7.20% |
2.83% |
19.36% |
12.31% |
12.42% |
15.45% |
14.01% |
20.43% |
12.63% |
PPT |
55.43% |
54.27% |
53.66% |
52.18% |
55.37% |
54.74% |
50.88% |
51.21% |
49.88% |
SSPO |
52.40% |
53.74% |
53.46% |
52.43% |
52.97% |
52.55% |
48.35% |
45.92% |
47.11% |
Classic OLPS: Follow-the-loser |
|||||||||
ANTI1 |
18.16% |
22.99% |
13.82% |
21.42% |
20.47% |
16.49% |
17.08% |
14.90% |
16.78% |
ANTI2 |
27.21% |
27.40% |
20.65% |
24.09% |
25.51% |
25.93% |
19.19% |
21.25% |
25.79% |
PAMR |
84.99% |
67.16% |
86.00% |
66.67% |
78.49% |
66.67% |
68.28% |
74.41% |
65.21% |
CWMR-Var |
84.06% |
65.77% |
84.85% |
65.69% |
77.52% |
64.42% |
67.38% |
73.44% |
63.70% |
CWMR-Stdev |
84.06% |
65.55% |
84.85% |
65.59% |
77.51% |
64.34% |
67.32% |
73.50% |
63.71% |
OLMAR-S |
64.43% |
58.68% |
60.99% |
56.49% |
63.65% |
57.63% |
60.71% |
56.13% |
55.64% |
OLMAR-E |
75.44% |
73.34% |
71.47% |
72.21% |
72.83% |
69.81% |
70.84% |
67.00% |
62.46% |
RMR |
66.00% |
54.58% |
63.00% |
54.73% |
67.49% |
57.97% |
58.47% |
57.75% |
54.69% |
RPRT |
72.71% |
69.78% |
65.47% |
68.52% |
68.70% |
66.52% |
66.28% |
65.33% |
58.06% |
Classic OLPS: Pattern-matching |
|||||||||
AICTR |
63.30% |
69.44% |
58.47% |
69.34% |
66.41% |
63.36% |
69.31% |
61.37% |
59.14% |
KTPT |
87.05% |
81.88% |
79.46% |
72.07% |
76.36% |
70.96% |
70.94% |
63.17% |
69.87% |
Classic OLPS: Meta-learning |
|||||||||
SP |
0.57% |
0.75% |
1.24% |
1.01% |
1.06% |
1.98% |
1.94% |
1.52% |
0.96% |
ONS |
4.25% |
4.66% |
9.17% |
9.27% |
9.53% |
7.99% |
10.83% |
5.12% |
6.01% |
GRW |
0.57% |
6.39% |
13.24% |
14.76% |
12.99% |
11.55% |
11.69% |
8.23% |
6.07% |
WAAS |
0.59% |
0.76% |
1.63% |
1.12% |
1.22% |
2.14% |
2.11% |
1.76% |
1.01% |
CW-OGD |
0.57% |
2.07% |
1.96% |
6.29% |
1.87% |
3.59% |
4.69% |
2.21% |
1.21% |
备注
“–” 表示该方法产生(几乎)没有交易成本。
结果显示盈利能力与实用性之间存在权衡。一些方法在重度调整投资组合的代价下获得高回报。因此,理想的数据驱动 OLPS 应该在现实约束下优化回报。基准促进了开发降低再平衡频率和减少换手率的机制。
除了对 ATO 的评估,我们还考察了运行时间(RT)指标,作为 OLPS 性能的实用衡量标准。下表展示了 FinOL 上的 RT 结果。可以总结出几个关键观察:
一些 OLPS 方法在资产数量方面的可扩展性较差,特别是 SCRP 和 SSPO。这主要是因为它们过去的开发严重依赖于
OLPS数据库,而该数据库恰好不涉及任何大规模数据集。大多数 OLPS 方法在运行时间方面表现良好。
模型 |
NYSE(O) |
NYSE(N) |
DJIA |
SP500 |
TSE |
SSE |
HSI |
CMEG |
CRYPTO |
|---|---|---|---|---|---|---|---|---|---|
Classic OLPS: Benchmark baseline |
|||||||||
Market |
– |
– |
– |
– |
– |
– |
– |
– |
– |
Best |
– |
– |
– |
– |
– |
– |
– |
– |
– |
UCRP |
0.0041322 |
0.0059764 |
0.0003916 |
0.001057 |
0.000611 |
0.0002481 |
0.0002688 |
0.000459 |
0.0008224 |
BCRP |
0.0038118 |
0.0067816 |
0.0002166 |
0.001065 |
0.000996 |
0.000306 |
0.0002986 |
0.000275 |
0.0008464 |
Classic OLPS: Follow-the-winner |
|||||||||
UP |
1.8864056 |
0.0719632 |
0.0254685 |
0.01317 |
0.091344 |
0.0412119 |
0.0512968 |
0.037949 |
0.4567986 |
EG |
0.0209176 |
0.7080021 |
0.0007138 |
0.021471 |
0.0023 |
0.0009838 |
0.0014511 |
0.001174 |
0.0048522 |
SCRP |
21.3714095 |
3563.216028 |
2.1666272 |
751.7104 |
5.162115 |
1.3369282 |
4.1774117 |
1.326479 |
10.0444827 |
PPT |
0.0220539 |
1.4248651 |
0.000765 |
0.067611 |
0.002196 |
0.0011361 |
0.0016884 |
0.000959 |
0.0038207 |
SSPO |
10.365433 |
1593.101725 |
4.6482987 |
285.346 |
11.55126 |
5.7671978 |
6.5936851 |
2.656706 |
19.6497393 |
Classic OLPS: Follow-the-loser |
|||||||||
ANTI1 |
2.412872 |
942.9277071 |
0.9028023 |
89.10436 |
4.825674 |
1.5139913 |
3.4485262 |
1.232613 |
6.3589876 |
ANTI2 |
5.3055469 |
1019.015005 |
0.7316441 |
67.97805 |
6.081596 |
1.8371354 |
5.6760943 |
2.697906 |
11.1037912 |
PAMR |
0.0281713 |
0.6058916 |
0.0016882 |
0.016369 |
0.003871 |
0.0021293 |
0.0024729 |
0.002359 |
0.0094379 |
CWMR-Var |
0.0486561 |
5.0129114 |
0.0021516 |
0.384601 |
0.006705 |
0.0036254 |
0.0053173 |
0.002194 |
0.0118123 |
CWMR-Stdev |
0.0554241 |
7.6208348 |
0.0030268 |
0.89136 |
0.009707 |
0.0057918 |
0.0093459 |
0.00356 |
0.0203114 |
OLMAR-S |
0.0388321 |
0.6172465 |
0.0016541 |
0.012853 |
0.003063 |
0.0014739 |
0.0017771 |
0.001449 |
0.0065995 |
OLMAR-E |
0.0398049 |
0.6097762 |
0.0012705 |
0.012054 |
0.002877 |
0.0018873 |
0.0021814 |
0.001494 |
0.0063896 |
RMR |
0.1065905 |
0.4709969 |
0.005274 |
0.060043 |
0.012206 |
0.0084572 |
0.0093933 |
0.009332 |
0.0335466 |
RPRT |
0.0483275 |
2.3619424 |
0.0022602 |
0.089113 |
0.003629 |
0.0017498 |
0.0022784 |
0.001699 |
0.0074966 |
Classic OLPS: Pattern-matching |
|||||||||
AICTR |
0.1552033 |
10.3116284 |
0.0036974 |
0.441138 |
0.009328 |
0.0039644 |
0.0060411 |
0.003575 |
0.0364883 |
KTPT |
1.33071 |
5.1376433 |
0.0563649 |
0.506718 |
0.498936 |
0.6813439 |
0.5995139 |
0.704583 |
1.9678092 |
Classic OLPS: Meta-learning |
|||||||||
SP |
0.0786008 |
1.8743168 |
0.0124197 |
0.336125 |
0.016422 |
0.0049131 |
0.0063926 |
0.016176 |
0.0561672 |
ONS |
1.5128513 |
701.8432832 |
0.1277076 |
13.5781 |
0.250247 |
0.0999844 |
0.1304165 |
0.094656 |
0.5413568 |
GRW |
0.7999147 |
44.0762048 |
0.0620426 |
8.250292 |
0.374519 |
0.0961017 |
0.3086175 |
0.085338 |
0.8238871 |
WAAS |
1.0277107 |
295.7563543 |
0.1262029 |
45.77576 |
0.626888 |
0.425847 |
0.8555393 |
0.197126 |
1.9221044 |
CW-OGD |
0.0373499 |
1.8004252 |
0.0027351 |
0.210646 |
0.007928 |
0.0042008 |
0.0057244 |
0.003265 |
0.0165171 |
备注
所有时间均以秒为单位报告。
运行时间(RT)是一个重要的考虑因素,通常在回测中被忽视,但对现实中的 OLPS 任务至关重要。为了解决这一挑战,FinOL 为研究人员提供了两个大型数据集:NYSE(N) 和 SP500。这些数据集为研究人员提供了开发既有盈利能力又具实用性的 OLPS 方法的机会。