Compile pylint with mypyc to improve performance.

[feluxe]

Current problem

pylint seems kinda slow.

When I run it with time on a 400 LOC file:

> time pylint smartctl-check.py
...
------------------------------------------------------------------
Your code has been rated at 8.45/10 (previous run: 8.45/10, +0.00)

smartctl-check.py  2.82s user 0.12s system 92% cpu 3.202 total

This is annoying when I cleanup warnings in my editor, because every time I fix one I have to wait 3 seconds until the warnings render again, in order to continue. This makes my Python workflow unsmooth, because I'm constantly waiting for the warnings to render.

Desired solution

Compile pylint with mypyc.

Additional context

I think black and mypy are compiled with mypyc.

The mypy project has been using mypyc to compile mypy since 2019, giving it a 4x performance boost over regular Python.

Maybe this would be an option for pylint is well?

Mypyc benchmarks look promising:

• Benchmark results
• Microbenchmark results

[CarliJoy]

I am fully in favour of this sugesstion.
See also:
https://glyph.twistedmatrix.com/2022/04/you-should-compile-your-python-and-heres-why.html

Probably we also need to compile astroid

[Pierre-Sassoulas]

We've got a long way to go before being able to do that, right now astroid cannot activate mypy even without --strict. The performance bottle neck is in astroid and astroid has less contributors and is harder to type than pylint. We welcome any contribution to the typing in both pylint and astroid. In pylint there's #2079, and pylint-dev/astroid#1287 for astroid.

[askfiy]

Totally agree, pylint is really slow these days. but i love it...

[Pierre-Sassoulas]

The typing is fully done in pylint, we might have some benefits already, no idea how much. It's certainly not going to hurt if we try.