Show HN: Compute polynomials twice as fast

thomasahle.com

80 points by thomasahle a day ago


A few years ago my coauthor and I was wondering if we could reduce the number of multiplications used for hashing algorithms. We had a construction and a 100 page proof, but we were not 100% sure it was correct. Now we have a full Lean proof, so we decided to publish it.

I made this website to make it easy for anyone how has polynomials to evaluate to see how it would be done using our method, as well as a number of previous approaches by Knuth and others.

emil-lp - 9 minutes ago

I read your arxiv paper yesterday (or was it the day before).

Do you think this can be used to speed up the algebraic method for k-path?

If so, you should enter next years PACE challenge.

pvillano - 2 hours ago

This is super cool. I learned a lot playing with the demo. I only knew Horner and Estrin, but I think I've gotten a grasp on most of them.

One small change I'd recommend is for the graph visualization, have a separate source node for each x, x^2, x^4 used. A single x source clutters the graph and hides the structure.

throwaway81523 - 2 hours ago

If you're going to preprocess the polynomial, maybe you want to evaluate it at many different points. But then why not use the FFT?

voxelghost - 6 hours ago

It keeps flipping back to 'monic' from e.g. 'ln(1+x)' when switching between algorithms, and then seems to lock to 'monic'? (Am I missing something?)

Also I am curious, in your version vs. horner , how do both algorithms map onto number of fmadd operations?

- a day ago
[deleted]
vlovich123 - 6 hours ago

Would this be applicable to fast hashes like WyHash and xxh3 or are those not using polynomials? Is this mainly for faster cryptographic hashes?

thomasahle - 2 hours ago

See also discussions here https://www.reddit.com/r/programming/comments/1wbgcke/commen... on how the actual math works out.

aetherspawn - 6 hours ago

I guess it’s not faster than using a table for CRC8?

gowld - 6 hours ago

From the abstract, a name that many on HN would recognize:

> We also give an injective polynomial construction for universal hashing that uses N multiplications to hash 2N values with a single random key. This improves the best previous construction by Daniel J. Bernstein (this http URL).

gowld - 6 hours ago

What is the tradeoff between multiplication and addition?