Q22 Quick Start S&P500¶
Introduction to S&P500 stocks, a quick-start example strategy that dynamically selects low-volatility stocks and allocates capital based on their transaction volume.
You can clone and edit this example there (tab Examples).
Introduction to S&P500 stocks¶
This template demonstrates how to build a trading strategy, specifically designed for use with a dataset containing historical constituents of the S&P 500. The strategy can only trade stocks that are part of the S&P 500 index, and only when the stock is considered liquid. A company is deemed liquid if it is included in the S&P 500 at the observed point in time.
The strategy takes a low-risk approach by allocating weights to stocks based on their volatility. It assigns capital only when the ratio of the Average True Range (ATR(14)) to the closing price is below 0.0205, signaling lower volatility. The allocation is further refined by the stock's transaction money flow, where stocks with higher liquidity and trading volume receive a larger portion of the capital (weight). This approach ensures that more capital is directed towards assets with higher market activity, while also maintaining a risk-aware allocation.
Important Considerations:
- Trade only on historical S&P 500 stocks, and only when they are considered liquid (i.e., part of the index at the time of observation).
- The in-sample period begins on 2006-01-01. Earlier data may be used for testing and training purposes.
- The strategy must achieve a minimum in-sample Sharpe Ratio of 0.70 to be considered valid.
- The maximum allocation to any single asset is capped at 10% of total capital. If a weight exceeds this, it will be limited to 0.1.
- Manual stock selection or direct hand-picking is not permitted. The allocation process must be automatic.
- The strategy can open both long and short positions.
For official Q22 rules, click here.
Accessing the S&P 500 Stocks Dataset - Data loading¶
For the Q22 contest, a new dataset of S&P 500 stocks is available. You can obtain this dataset by calling the function stocks_load_spx_data() from the data module:
snp_stocks_data = qndata.stocks_load_spx_data(min_date='2005-06-01')
To check the list of S&P 500 companies starting from 2006-01-01, along with additional stock information, use the load_list() function:
snp_stocks_list = qndata.stocks_load_spx_list()
Quantiacs also provides data for other instruments, such as cryptocurrencies, indices, futures, as well as additional fundamental stock data and macroeconomic data. Note that there is also a Nasdaq-100 dataset available, and it is not a subset of the S&P 500. However, there is a significant overlap between the two.
The data is provided in xarray.DataArray format. Check here for more details on manipulating xarray data.
Technical analysis - indicators
Once the data is loaded, various technical indicators from the qnt.ta module can be used to generate trading signals. For a complete list of indicators and examples of their implementation, check the documentation page.
Trading strategy - algorithm¶
# Necessary imports
import xarray as xr
import numpy as np
import qnt.stats as qnstats
import qnt.data as qndata
import qnt.output as qnout
import qnt.ta as qnta
import qnt.backtester as qnbt
import qnt.graph as qngraph
def strategy(data, state=None, mfsp=135, limit=0.0205): # parameter state is used in the backtester (multi-pass) for stateful strategies
vol = data.sel(field="vol") ### Volume values
liq = data.sel(field="is_liquid") ### Liquidity values, 1.0 or 0.0 -> True or False
close = data.sel(field="close") ### close prices
high = data.sel(field="high") ### daily high
low = data.sel(field="low") ### daily low
atrs = qnta.atr(high=high, low=low, close=close, ma=14) ### Average True Range of 14 bars (working days)
ratio = atrs / close ### indicator
weights = xr.where(ratio > limit, 0, 1) ### Strategy condition - zero weight if ratio is bigger than limit
money_vol = vol * liq * close ### Daily money flow per liquid asset
total_money_vol = money_vol.sum(dim='asset', skipna=True) ### Total daily money flow of liquid assets
money_vol_share = money_vol / total_money_vol ### Daily money flow share per liquid asset
mvs_mov = qnta.sma(money_vol_share, mfsp) ### weights allocation by average money flow share in period of 135 days
return mvs_mov * weights
Weights - Single / Multi pass approach¶
In Single pass backtesting, which is significantly faster, weights are calculated using the entire dataset in a single run.
Multi pass backtesting evaluates weights on a day-by-day basis by slicing the dataset for each individual day.
If applicable, we recommend using the single pass approach for efficiency, while verifying strategy statistics with the multi pass backtester. If the statistics from single pass and multi pass match exactly, it indicates that forward-looking bias has likely not been introduced, and the strategy can be confidently submitted as single pass.
In rare cases, even if results are identical between single and multi pass, forward-looking bias might unintentionally occur (e.g., by incorporating global data variables into the logic). Such issues are generally mitigated in production but can result in discrepancies in statistics comparing development and production results.
### SINGLE PASS ###
## The min_date parameter is set to '2005-06-01' to ensure that the dataset includes at least 135 bars (approximately 190 days) of data,
## which is necessary for creating indicators and determining weights for the strategy.
snp_stocks_data = qndata.stocks_load_spx_data(min_date='2005-06-01')
weights = strategy(snp_stocks_data)
weights = qnout.clean(weights, snp_stocks_data) # fix liquidity
0% (0 of 367973) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (367973 of 367973) |################| Elapsed Time: 0:00:00 Time: 0:00:00
0% (0 of 123921) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (123921 of 123921) |################| Elapsed Time: 0:00:00 Time: 0:00:00
0% (0 of 13248856) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5829472 of 13248856) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11526456 of 13248856) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248856 of 13248856) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 1/20 1s
0% (0 of 13248856) | | Elapsed Time: 0:00:00 ETA: --:--:--
39% (5299520 of 13248856) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
81% (10864016 of 13248856) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248856 of 13248856) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 2/20 2s
0% (0 of 13248852) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5829472 of 13248852) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
78% (10466552 of 13248852) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
98% (13116312 of 13248852) |########### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248852 of 13248852) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 3/20 3s
0% (0 of 13248856) | | Elapsed Time: 0:00:00 ETA: --:--:--
41% (5564496 of 13248856) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
84% (11261480 of 13248856) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248856 of 13248856) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 4/20 4s
0% (0 of 13248852) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5829472 of 13248852) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11526456 of 13248852) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248852 of 13248852) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 5/20 6s
0% (0 of 13248852) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5829472 of 13248852) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11526456 of 13248852) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248852 of 13248852) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 6/20 7s
0% (0 of 13248824) | | Elapsed Time: 0:00:00 ETA: --:--:--
41% (5564496 of 13248824) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
81% (10864016 of 13248824) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248824 of 13248824) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 7/20 9s
0% (0 of 13248824) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5829472 of 13248824) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11526456 of 13248824) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248824 of 13248824) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 8/20 10s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 9/20 13s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 10/20 15s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 11/20 17s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
22% (3047201 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
44% (5961915 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
67% (9009116 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
88% (11791343 of 13248744) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 12/20 18s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
22% (3047201 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
44% (5961915 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
65% (8744142 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
86% (11526369 of 13248744) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 13/20 20s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
22% (3047201 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
43% (5829428 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
65% (8744142 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
87% (11658856 of 13248744) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 14/20 21s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
22% (3047201 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
44% (5961915 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
67% (9009116 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
88% (11791343 of 13248744) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 15/20 23s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
20% (2782227 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
43% (5829428 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
65% (8744142 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 16/20 24s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
20% (2782227 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
56% (7551759 of 13248744) |####### | Elapsed Time: 0:00:00 ETA: 0:00:00
98% (13116213 of 13248744) |########### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 17/20 26s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
21% (2914714 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
43% (5829428 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
65% (8744142 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
86% (11526369 of 13248744) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 18/20 27s
0% (0 of 13248744) | | Elapsed Time: 0:00:00 ETA: --:--:--
20% (2782227 of 13248744) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
41% (5564454 of 13248744) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
63% (8479168 of 13248744) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
86% (11526369 of 13248744) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (13248744 of 13248744) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 19/20 28s
0% (0 of 9699828) | | Elapsed Time: 0:00:00 ETA: --:--:--
29% (2909940 of 9699828) |#### | Elapsed Time: 0:00:00 ETA: 00:00:00
58% (5722882 of 9699828) |######## | Elapsed Time: 0:00:00 ETA: 0:00:00
87% (8535824 of 9699828) |############ | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (9699828 of 9699828) |##############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 20/20 29s
Data loaded 30s
Output cleaning...
fix uniq
ffill if the current price is None...
Check liquidity...
WARNING! Strategy trades non-liquid assets.
Fix liquidity...
Ok.
Check missed dates...
Ok.
Normalization...
Output cleaning is complete.
When using the backtester for weight calculation, there is no need to manually load data or define a "load_data" function as input. It is only required to specify the competition_type (in this case, "stocks_s&p500"), and the corresponding data will be loaded automatically by default.
### MULTI PASS ###
w=qnbt.backtest(
competition_type="stocks_s&p500",
lookback_period=250,
start_date="2006-01-01",
strategy=strategy,
analyze=True,
)
Run last pass...
Load data...
0% (0 of 123921) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (123921 of 123921) |################| Elapsed Time: 0:00:00 Time: 0:00:00
0% (0 of 8865472) | | Elapsed Time: 0:00:00 ETA: --:--:--
63% (5673856 of 8865472) |######## | Elapsed Time: 0:00:00 ETA: 00:00:00
100% (8865472 of 8865472) |##############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 1/1 16s
Data loaded 16s
Run strategy...
Can't load state. [Errno 2] No such file or directory: '/root/state.in.pickle.gz'
Load data for cleanup...
0% (0 of 2185852) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (2185852 of 2185852) |##############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 1/1 27s
Data loaded 27s
Output cleaning...
fix uniq
ffill if the current price is None...
Check liquidity...
Ok.
Check missed dates...
Ok.
Normalization...
Output cleaning is complete.
Write result...
Write output: /root/fractions.nc.gz
Statistics¶
While the multi pass approach automatically displays the strategy’s statistics through the backtester, single pass mode only calculates the weights, so visualizing the stats must be done manually. You can use the helper print_stats function for this purpose:
def print_stats(stat):
display(stat.sel(time=slice('2006-01-01', None)).to_pandas().tail(10))
performance = stat.to_pandas()["equity"]
qngraph.make_plot_filled(performance.index, performance, name="PnL (Equity)", type="log")
def get_sharpe(stat):
return stat.isel(time=-1).sel(field="sharpe_ratio").item()
stat = qnstats.calc_stat(snp_stocks_data, weights.sel(time=slice('2006-01-01', None)))
print_stats(stat)
| field | equity | relative_return | volatility | underwater | max_drawdown | sharpe_ratio | mean_return | bias | instruments | avg_turnover | avg_holding_time |
|---|---|---|---|---|---|---|---|---|---|---|---|
| time | |||||||||||
| 2025-05-30 | 2.124037 | 0.001080 | 0.046713 | -0.015087 | -0.072093 | 0.848633 | 0.039643 | 1.0 | 688.0 | 0.028848 | 27.683301 |
| 2025-06-02 | 2.123961 | -0.000036 | 0.046709 | -0.015122 | -0.072093 | 0.848502 | 0.039632 | 1.0 | 688.0 | 0.028851 | 27.680160 |
| 2025-06-03 | 2.123680 | -0.000132 | 0.046704 | -0.015252 | -0.072093 | 0.848259 | 0.039617 | 1.0 | 688.0 | 0.028848 | 27.677169 |
| 2025-06-04 | 2.122562 | -0.000527 | 0.046699 | -0.015771 | -0.072093 | 0.847559 | 0.039581 | 1.0 | 688.0 | 0.028849 | 27.671442 |
| 2025-06-05 | 2.121589 | -0.000458 | 0.046695 | -0.016222 | -0.072093 | 0.846939 | 0.039548 | 1.0 | 688.0 | 0.028849 | 27.670979 |
| 2025-06-06 | 2.124096 | 0.001182 | 0.046691 | -0.015060 | -0.072093 | 0.848194 | 0.039603 | 1.0 | 688.0 | 0.028848 | 27.668127 |
| 2025-06-09 | 2.122180 | -0.000902 | 0.046686 | -0.015948 | -0.072093 | 0.847057 | 0.039546 | 1.0 | 688.0 | 0.028849 | 27.666946 |
| 2025-06-10 | 2.122814 | 0.000299 | 0.046682 | -0.015654 | -0.072093 | 0.847309 | 0.039554 | 1.0 | 688.0 | 0.028851 | 27.660129 |
| 2025-06-11 | 2.121454 | -0.000640 | 0.046677 | -0.016284 | -0.072093 | 0.846478 | 0.039511 | 1.0 | 688.0 | 0.028851 | 27.657368 |
| 2025-06-12 | 2.123770 | 0.001092 | 0.046673 | -0.015211 | -0.072093 | 0.847631 | 0.039561 | 1.0 | 688.0 | 0.028850 | 27.592401 |
get_sharpe(stat)
0.8476307531681879
Submit strategy to the competition¶
Use Submit button on my strategies page
Make sure that qnout.write(weights) has been added to cell, and the weights have been written. It is not required when using Multi pass backtester.
Note: After submitting the strategy to the contest, any weight exceeding 0.1 will be capped at that limit. You can apply weight normalization functions before submission, which may be more suitable, such as those that maintain the ratio between allocated weights. Details on these functions can be found here.
### Run this cell to get all weights below 0.1. This "hard cut" way is used on production if any weight exceeds 0.1.
### Any other normalization method can be used.
import qnt.exposure as qnexp
weights_capped = qnexp.cut_big_positions(weights=weights, max_weight=0.1)
Compare weights before and after normalization. Check the statistics again, it can change not only in negative way.
qnout.write(weights_capped)
Write output: /root/fractions.nc.gz
Common Reasons for Submission Rejection and Their Solutions¶
Here are some of the frequent reasons causing submission rejection in algorithmic trading competitions, and their corresponding remedies.
1) Missed call to write_output
Save algorithm weights, run code
qnt.output.write(weights)
2) Not eligible send to contest. In-Sample Sharpe must be larger than 0.7
Improve your algorithm. For example, you can use sections and get an algorithm that will pass the filter
- Example Trading System Optimization
- Example of a strategy using technical analysis indicators
Need help? Check the Documentation and find solutions/report problems in the Forum section.
3) Not enough bid information.
Run code
min_time = weights.time[abs(weights).fillna(0).sum('asset')> 0].min()
min_time
min_time must be less than or equal to January 1, 2006.
If min_time is larger than the starting date, we recommend to fill the starting values of the time series with non-vanishing values, for example a simple buy-and-hold strategy.
def get_enough_bid_for(data_, weights_):
time_traded = weights_.time[abs(weights_).fillna(0).sum('asset') > 0]
is_strategy_traded = len(time_traded)
if is_strategy_traded:
return xr.where(weights_.time < time_traded.min(), data_.sel(field="is_liquid"), weights_)
return weights_
weights_new = get_enough_bid_for(data, weights)
weights_new = weights_new.sel(time=slice("2006-01-01",None))