I dont know why the date is 2024-04-02, however the second part is the model and the state is None, and as the error is : File ~/book/qnt/state.py:12, in write(state)
10 path = get_env("OUT_STATE_PATH", "state.out.pickle.gz")
11 with gzip.open(path, 'wb') as gz:
---> 12 pickle.dump(state, gz)
13 log_info("State saved.")

AttributeError: Can't pickle local object 'Layer._initializer_tracker.<locals>.<lambda>' , the error occurs while dumping the state, which is none, the error message is unclear to me,besides pickle being unable to dump this object.ChatGPT suggests using dill instead of pickle. Do you maybe know more? Thx a lot. Regards

It was:

import gzip, pickle

from qnt.data import get_env
from qnt.log import log_err, log_info

def write(state):
    if state is None:
        return
    path = get_env("OUT_STATE_PATH", "state.out.pickle.gz")
    with gzip.open(path, 'wb') as gz:
        pickle.dump(state, gz)
        log_info("State saved.")

def read(path=None):
    if path is None:
        path = get_env("IN_STATE_PATH", "state.in.pickle.gz")
    try:
        with gzip.open(path, 'rb') as gz:
            res = pickle.load(gz)
            log_info("State loaded.")
            return res
    except Exception as e:
        log_err("Can't load state.", e)
        return None

It became:

import gzip, pickle

from qnt.data import get_env
from qnt.log import log_err, log_info

def write(state):
    if state is None:
        return
    print("state")
    print(state)
    path = get_env("OUT_STATE_PATH", "state.out.pickle.gz")
    with gzip.open(path, 'wb') as gz:
        pickle.dump(state, gz)
        log_info("State saved.")

def read(path=None):
    if path is None:
        path = get_env("IN_STATE_PATH", "state.in.pickle.gz")
    try:
        with gzip.open(path, 'rb') as gz:
            res = pickle.load(gz)
            log_info("State loaded.")
            return res
    except Exception as e:
        log_err("Can't load state.", e)
        return None

Save the file and restart the kernel.

print(state)

before saving it. What are you trying to save?

you may need to restart the kernel.

Answer ChatGPT:

The error message you're encountering, AttributeError: Can't pickle local object 'Layer._initializer_tracker.<locals>.<lambda>', indicates that the pickle module is unable to serialize a lambda function (or possibly another local object) that is part of the object state you're attempting to dump to a file. This is a common limitation of pickle, as it cannot serialize lambda functions, local functions, classes defined within functions, or instances of such classes, among other things.

Avoid Using Lambda Functions in Serializable Objects
If possible, replace lambda functions with defined functions (even if they're one-liners). Defined functions can be pickled because they are not considered local objects. For example, if you have:

lambda x: x + 1

Replace it with:

def increment(x):
    return x + 1

import sys
import platform

print("Python version (simple):", sys.version)
print("Python version (detailed):", platform.python_version())

Hi @Vyacheslav_B thx a lot for your suggestion. The versions are the same (3.10.13), so unfortunately that isnt the reason for the error.
regards

import sys
import platform

print("Python version (simple):", sys.version)
print("Python version (detailed):", platform.python_version())

File ~/book/qnt/backtester.py:119, in backtest_ml(train, predict, train_period, retrain_interval, predict_each_day, retrain_interval_after_submit, competition_type, load_data, lookback_period, test_period, start_date, end_date, window, analyze, build_plots, collect_all_states)
116 qnout.write(result)
118 if need_retrain and retrain_interval_cur > 1 or state is not None:
--> 119 qnstate.write((created, model, state))
121 if is_submitted():
122 if state is not None:

File ~/book/qnt/state.py:12, in write(state)
10 path = get_env("OUT_STATE_PATH", "state.out.pickle.gz")
11 with gzip.open(path, 'wb') as gz:
---> 12 pickle.dump(state, gz)
13 log_info("State saved.")

AttributeError: Can't pickle local object 'Layer._initializer_tracker.<locals>.<lambda>' unfortunately I dont get what is meant by that exactly. Thx a lot. Regards

There may be errors related to the absence of certain Python libraries in the online environment, the use of local files, and the application of variables or settings from the local environment.

It is important that the line

import qnt.output as qnout
qnout.write(weights)

is placed in a separate cell.