Why page 500 is slow
OFFSET 10000 makes the database find and discard ten thousand rows before returning any. The cost grows with the page number.
Keyset pagination instead
Remember the last row seen and ask for rows after it. The query stays constant-time regardless of depth, because it seeks rather than counts.
The trade-off
You lose the ability to jump to an arbitrary page number. For feeds and infinite scroll that is no loss; for an admin table with page links it may be.