Memory leak

[debsankha]

Memory leak: Run test/benchmark_cython_bruteforce_dispatcher.py and see.

[debsankha]

The memory leak can be reproduced just by doing:

def create_lots_of_requests(n):
    rs = []
    for i in range(n):
        r = TransportationRequest(42, 0, (1,2), (3,4), 0, 0, 0, 0)
        rs.append(r)
    return rs

[debsankha]

Could it be that there's a problem in the cythonic stuff because we haven't cpdefd some class methods but are still using them from cython side?

[fxjung]

One solution for now can be using the multiprocessing parameter scans introduced #144.

[fxjung]

Additional literature (contributed by Deb):

• https://stackoverflow.com/questions/1316767/how-can-i-explicitly-free-memory-in-python
• https://stackoverflow.com/questions/15455048/releasing-memory-in-python
• Cyclic GC issues pandas-dev/pandas#2659
• The consensus is: Either call malloc_trim or use multiprocessing.
• https://stackoverflow.com/a/15492488