Q22 Quick Start S&P500¶
Introduction to S&P500 stocks, a quick-start example strategy that dynamically selects low-volatility stocks and allocates capital based on their transaction volume.
You can clone and edit this example there (tab Examples).
Introduction to S&P500 stocks¶
This template demonstrates how to build a trading strategy, specifically designed for use with a dataset containing historical constituents of the S&P 500. The strategy can only trade stocks that are part of the S&P 500 index, and only when the stock is considered liquid. A company is deemed liquid if it is included in the S&P 500 at the observed point in time.
The strategy takes a low-risk approach by allocating weights to stocks based on their volatility. It assigns capital only when the ratio of the Average True Range (ATR(14)) to the closing price is below 0.0205, signaling lower volatility. The allocation is further refined by the stock's transaction money flow, where stocks with higher liquidity and trading volume receive a larger portion of the capital (weight). This approach ensures that more capital is directed towards assets with higher market activity, while also maintaining a risk-aware allocation.
Important Considerations:
- Trade only on historical S&P 500 stocks, and only when they are considered liquid (i.e., part of the index at the time of observation).
- The in-sample period begins on 2006-01-01. Earlier data may be used for testing and training purposes.
- The strategy must achieve a minimum in-sample Sharpe Ratio of 0.70 to be considered valid.
- The maximum allocation to any single asset is capped at 10% of total capital. If a weight exceeds this, it will be limited to 0.1.
- Manual stock selection or direct hand-picking is not permitted. The allocation process must be automatic.
- The strategy can open both long and short positions.
For official Q22 rules, click here.
Accessing the S&P 500 Stocks Dataset - Data loading¶
For the Q22 contest, a new dataset of S&P 500 stocks is available. You can obtain this dataset by calling the function stocks_load_spx_data() from the data module:
snp_stocks_data = qndata.stocks_load_spx_data(min_date='2005-06-01')
To check the list of S&P 500 companies starting from 2006-01-01, along with additional stock information, use the load_list() function:
snp_stocks_list = qndata.stocks_load_spx_list()
Quantiacs also provides data for other instruments, such as cryptocurrencies, indices, futures, as well as additional fundamental stock data and macroeconomic data. Note that there is also a Nasdaq-100 dataset available, and it is not a subset of the S&P 500. However, there is a significant overlap between the two.
The data is provided in xarray.DataArray format. Check here for more details on manipulating xarray data.
Technical analysis - indicators
Once the data is loaded, various technical indicators from the qnt.ta module can be used to generate trading signals. For a complete list of indicators and examples of their implementation, check the documentation page.
Trading strategy - algorithm¶
# Necessary imports
import xarray as xr
import numpy as np
import qnt.stats as qnstats
import qnt.data as qndata
import qnt.output as qnout
import qnt.ta as qnta
import qnt.backtester as qnbt
import qnt.graph as qngraph
def strategy(data, state=None, mfsp=135, limit=0.0205): # parameter state is used in the backtester (multi-pass) for stateful strategies
vol = data.sel(field="vol") ### Volume values
liq = data.sel(field="is_liquid") ### Liquidity values, 1.0 or 0.0 -> True or False
close = data.sel(field="close") ### close prices
high = data.sel(field="high") ### daily high
low = data.sel(field="low") ### daily low
atrs = qnta.atr(high=high, low=low, close=close, ma=14) ### Average True Range of 14 bars (working days)
ratio = atrs / close ### indicator
weights = xr.where(ratio > limit, 0, 1) ### Strategy condition - zero weight if ratio is bigger than limit
money_vol = vol * liq * close ### Daily money flow per liquid asset
total_money_vol = money_vol.sum(dim='asset', skipna=True) ### Total daily money flow of liquid assets
money_vol_share = money_vol / total_money_vol ### Daily money flow share per liquid asset
mvs_mov = qnta.sma(money_vol_share, mfsp) ### weights allocation by average money flow share in period of 135 days
return mvs_mov * weights
Weights - Single / Multi pass approach¶
In Single pass backtesting, which is significantly faster, weights are calculated using the entire dataset in a single run.
Multi pass backtesting evaluates weights on a day-by-day basis by slicing the dataset for each individual day.
If applicable, we recommend using the single pass approach for efficiency, while verifying strategy statistics with the multi pass backtester. If the statistics from single pass and multi pass match exactly, it indicates that forward-looking bias has likely not been introduced, and the strategy can be confidently submitted as single pass.
In rare cases, even if results are identical between single and multi pass, forward-looking bias might unintentionally occur (e.g., by incorporating global data variables into the logic). Such issues are generally mitigated in production but can result in discrepancies in statistics comparing development and production results.
### SINGLE PASS ###
## The min_date parameter is set to '2005-06-01' to ensure that the dataset includes at least 135 bars (approximately 190 days) of data,
## which is necessary for creating indicators and determining weights for the strategy.
snp_stocks_data = qndata.stocks_load_spx_data(min_date='2005-06-01')
weights = strategy(snp_stocks_data)
weights = qnout.clean(weights, snp_stocks_data) # fix liquidity
0% (0 of 367973) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (367973 of 367973) |################| Elapsed Time: 0:00:00 Time: 0:00:00
0% (0 of 124689) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (124689 of 124689) |################| Elapsed Time: 0:00:00 Time: 0:00:00
0% (0 of 12992880) | | Elapsed Time: 0:00:00 ETA: --:--:--
39% (5197120 of 12992880) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
82% (10784024 of 12992880) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992880 of 12992880) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 1/21 2s
0% (0 of 12992876) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716832 of 12992876) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
87% (11433664 of 12992876) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992876 of 12992876) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 2/21 3s
0% (0 of 12992876) | | Elapsed Time: 0:00:00 ETA: --:--:--
35% (4677408 of 12992876) |#### | Elapsed Time: 0:00:00 ETA: 00:00:00
79% (10394240 of 12992876) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992876 of 12992876) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 3/21 5s
0% (0 of 12992876) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (12992876 of 12992876) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 4/21 6s
0% (0 of 12992880) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (12992880 of 12992880) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 5/21 7s
0% (0 of 12992880) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (12992880 of 12992880) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 6/21 8s
0% (0 of 12992852) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (12992852 of 12992852) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 7/21 10s
0% (0 of 12992852) | | Elapsed Time: 0:00:00 ETA: --:--:--
31% (4157696 of 12992852) |#### | Elapsed Time: 0:00:00 ETA: 00:00:00
75% (9874528 of 12992852) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992852 of 12992852) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 8/21 11s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716788 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
87% (11433576 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 9/21 12s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716788 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11303649 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 10/21 14s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716788 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11303649 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 11/21 15s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716788 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
87% (11433576 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 12/21 16s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716788 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
87% (11433576 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 13/21 17s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
40% (5327007 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
84% (11043795 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 14/21 18s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
44% (5846715 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
88% (11563503 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 15/21 20s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
21% (2858394 of 12992772) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
51% (6756204 of 12992772) |###### | Elapsed Time: 0:00:00 ETA: 0:00:00
93% (12213138 of 12992772) |########### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 16/21 21s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
20% (2728467 of 12992772) |## | Elapsed Time: 0:00:00 ETA: 00:00:00
39% (5197080 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 0:00:00
56% (7405839 of 12992772) |####### | Elapsed Time: 0:00:00 ETA: 0:00:00
91% (11953284 of 12992772) |########### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 17/21 22s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
43% (5716788 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
86% (11303649 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 18/21 24s
0% (0 of 12992772) | | Elapsed Time: 0:00:00 ETA: --:--:--
44% (5846715 of 12992772) |##### | Elapsed Time: 0:00:00 ETA: 00:00:00
88% (11563503 of 12992772) |########## | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992772 of 12992772) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 19/21 25s
0% (0 of 12992852) | | Elapsed Time: 0:00:00 ETA: --:--:--
27% (3637984 of 12992852) |### | Elapsed Time: 0:00:00 ETA: 00:00:00
70% (9224888 of 12992852) |######### | Elapsed Time: 0:00:00 ETA: 0:00:00
100% (12992852 of 12992852) |############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 20/21 26s
0% (0 of 4561052) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (4561052 of 4561052) |##############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 21/21 27s
Data loaded 28s
Output cleaning...
fix uniq
ffill if the current price is None...
Check liquidity...
WARNING! Strategy trades non-liquid assets.
Fix liquidity...
Ok.
Check missed dates...
Ok.
Normalization...
Output cleaning is complete.
When using the backtester for weight calculation, there is no need to manually load data or define a "load_data" function as input. It is only required to specify the competition_type (in this case, "stocks_s&p500"), and the corresponding data will be loaded automatically by default.
### MULTI PASS ###
w=qnbt.backtest(
competition_type="stocks_s&p500",
lookback_period=250,
start_date="2006-01-01",
strategy=strategy,
analyze=True,
)
Run last pass...
Load data...
0% (0 of 124689) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (124689 of 124689) |################| Elapsed Time: 0:00:00 Time: 0:00:00
0% (0 of 8816056) | | Elapsed Time: 0:00:00 ETA: --:--:--
63% (5642240 of 8816056) |######## | Elapsed Time: 0:00:00 ETA: 00:00:00
100% (8816056 of 8816056) |##############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 1/1 10s
Data loaded 10s
Run strategy...
Can't load state. [Errno 2] No such file or directory: '/root/state.in.pickle.gz'
Load data for cleanup...
0% (0 of 2095156) | | Elapsed Time: 0:00:00 ETA: --:--:--
100% (2095156 of 2095156) |##############| Elapsed Time: 0:00:00 Time: 0:00:00
fetched chunk 1/1 27s
Data loaded 27s
Output cleaning...
fix uniq
ffill if the current price is None...
Check liquidity...
WARNING! Strategy trades non-liquid assets.
Fix liquidity...
Ok.
Check missed dates...
Ok.
Normalization...
Output cleaning is complete.
Write result...
Write output: /root/fractions.nc.gz
Statistics¶
While the multi pass approach automatically displays the strategy’s statistics through the backtester, single pass mode only calculates the weights, so visualizing the stats must be done manually. You can use the helper print_stats function for this purpose:
def print_stats(stat):
display(stat.sel(time=slice('2006-01-01', None)).to_pandas().tail(10))
performance = stat.to_pandas()["equity"]
qngraph.make_plot_filled(performance.index, performance, name="PnL (Equity)", type="log")
def get_sharpe(stat):
return stat.isel(time=-1).sel(field="sharpe_ratio").item()
stat = qnstats.calc_stat(snp_stocks_data, weights.sel(time=slice('2006-01-01', None)))
print_stats(stat)
| field | equity | relative_return | volatility | underwater | max_drawdown | sharpe_ratio | mean_return | bias | instruments | avg_turnover | avg_holding_time |
|---|---|---|---|---|---|---|---|---|---|---|---|
| time | |||||||||||
| 2025-07-09 | 2.134029 | 0.000713 | 0.046619 | -0.010453 | -0.072093 | 0.851128 | 0.039679 | 1.0 | 688.0 | 0.028828 | 27.603816 |
| 2025-07-10 | 2.135458 | 0.000670 | 0.046615 | -0.009791 | -0.072093 | 0.851802 | 0.039706 | 1.0 | 688.0 | 0.028826 | 27.603137 |
| 2025-07-11 | 2.132191 | -0.001530 | 0.046612 | -0.011306 | -0.072093 | 0.849930 | 0.039617 | 1.0 | 688.0 | 0.028825 | 27.600967 |
| 2025-07-14 | 2.133881 | 0.000793 | 0.046607 | -0.010522 | -0.072093 | 0.850743 | 0.039651 | 1.0 | 688.0 | 0.028834 | 27.598170 |
| 2025-07-15 | 2.126815 | -0.003311 | 0.046609 | -0.013799 | -0.072093 | 0.846737 | 0.039465 | 1.0 | 688.0 | 0.028832 | 27.597714 |
| 2025-07-16 | 2.128642 | 0.000859 | 0.046604 | -0.012951 | -0.072093 | 0.847626 | 0.039503 | 1.0 | 688.0 | 0.028832 | 27.590363 |
| 2025-07-17 | 2.132671 | 0.001892 | 0.046601 | -0.011083 | -0.072093 | 0.849668 | 0.039596 | 1.0 | 688.0 | 0.028830 | 27.589243 |
| 2025-07-18 | 2.133301 | 0.000295 | 0.046597 | -0.010791 | -0.072093 | 0.849916 | 0.039603 | 1.0 | 688.0 | 0.028830 | 27.586411 |
| 2025-07-21 | 2.134501 | 0.000563 | 0.046592 | -0.010234 | -0.072093 | 0.850468 | 0.039625 | 1.0 | 688.0 | 0.028830 | 27.582446 |
| 2025-07-22 | 2.137506 | 0.001408 | 0.046588 | -0.008841 | -0.072093 | 0.851971 | 0.039692 | 1.0 | 688.0 | 0.028833 | 27.563176 |
get_sharpe(stat)
0.8519711920676515
Submit strategy to the competition¶
Use Submit button on my strategies page
Make sure that qnout.write(weights) has been added to cell, and the weights have been written. It is not required when using Multi pass backtester.
Note: After submitting the strategy to the contest, any weight exceeding 0.1 will be capped at that limit. You can apply weight normalization functions before submission, which may be more suitable, such as those that maintain the ratio between allocated weights. Details on these functions can be found here.
### Run this cell to get all weights below 0.1. This "hard cut" way is used on production if any weight exceeds 0.1.
### Any other normalization method can be used.
import qnt.exposure as qnexp
weights_capped = qnexp.cut_big_positions(weights=weights, max_weight=0.1)
Compare weights before and after normalization. Check the statistics again, it can change not only in negative way.
qnout.write(weights_capped)
Write output: /root/fractions.nc.gz
Common Reasons for Submission Rejection and Their Solutions¶
Here are some of the frequent reasons causing submission rejection in algorithmic trading competitions, and their corresponding remedies.
1) Missed call to write_output
Save algorithm weights, run code
qnt.output.write(weights)
2) Not eligible send to contest. In-Sample Sharpe must be larger than 0.7
Improve your algorithm. For example, you can use sections and get an algorithm that will pass the filter
- Example Trading System Optimization
- Example of a strategy using technical analysis indicators
Need help? Check the Documentation and find solutions/report problems in the Forum section.
3) Not enough bid information.
Run code
min_time = weights.time[abs(weights).fillna(0).sum('asset')> 0].min()
min_time
min_time must be less than or equal to January 1, 2006.
If min_time is larger than the starting date, we recommend to fill the starting values of the time series with non-vanishing values, for example a simple buy-and-hold strategy.
def get_enough_bid_for(data_, weights_):
time_traded = weights_.time[abs(weights_).fillna(0).sum('asset') > 0]
is_strategy_traded = len(time_traded)
if is_strategy_traded:
return xr.where(weights_.time < time_traded.min(), data_.sel(field="is_liquid"), weights_)
return weights_
weights_new = get_enough_bid_for(data, weights)
weights_new = weights_new.sel(time=slice("2006-01-01",None))