Nicolaj Rux | Mathematics








Portrait of Nicolaj Rux




I am a PhD candidate in Mathematics at Chemnitz University of Technology. My supervisor is Prof. Dr. Sebastian Neumayer.

My research interests include functional analysis, Fourier analysis, reproducing kernel Hilbert spaces, and kernel methods. I am particularly interested in efficient numerical methods for kernels and related variational problems.

I also work on Python and CUDA programming for fast and practical implementations of kernel-based algorithms and numerical methods.






Publications & Preprints

2026 Wasserstein gradient flows for Moreau envelopes of f-divergences in reproducing kernel Hilbert spaces
Viktor Stein, Sebastian Neumayer, Nicolaj Rux, Gabriele Steidl
Analysis and Applications, 24(1), 21-65.
[Journal] [arXiv] [GitHub]
2026 Smoothed Distance Kernels for MMDs and Applications in Wasserstein Gradient Flows
Nicolaj Rux, Michael Quellmalz, Gabriele Steidl
Advances in Computational Mathematics, 52.
[Journal] [arXiv]
2025 Wasserstein gradient flows of maximum mean discrepancy functionals with distance kernels under Sobolev regularization
Richard Duong, Nicolaj Rux, Viktor Stein, Gabriele Steidl
Philosophical Transactions of the Royal Society A, 383(2298).
[Journal] [arXiv]
2025 Slicing of radial functions: a dimension walk in the Fourier space
Nicolaj Rux, Michael Quellmalz, Gabriele Steidl
Sampling Theory, Signal Processing, and Data Analysis, 23(1), 6.
[Journal] [arXiv]
2025 Numerical Methods for Kernel Slicing
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
arXiv preprint arXiv:2510.11478.
[arXiv] [GitHub]
2026 Quasi Linear Kernel Attention with Infinite Capacity
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
arXiv preprint arXiv:2609.35349.
[arXiv] [GitHub]
2026 Fast Gauss Sums via Flash Attention
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
arXiv preprint arXiv:2609.04910.
[arXiv] [GitHub]





Repositorys & Projects

2026 Weighted absolute value sumation
Time- and memory-efficient CUDA/C++ implementation for large-scale weighted absolute value summations, supports batching and gradients, exposed as a PyTorch extension.
For q in R^(D x N), k in R^(D x M), v in R^(N x C) computes:
            out[m,c] = Σ_{d=0}^{D-1} Σ_{n=0}^{N-1} |q[d,n] - k[d,m]| · v[n,c]
Code aviable on [GitHub]

2025 Kernel Slicing
Pytorch implementation for numerical inversion of Slicing operator
For given function F inverts the Slicing Operator S_d : L^2([0,1]) -> L^2([0,1]) defined as
            F(s)=(Sf)(s) = ∫_0^1 f(t·s) ρ_d(t) dt with ρ_d(t) = c_d (1 - t^2)^((d-3)/2) 
Code aviable on [GitHub]

2025 TUB Treasure Trail
Scavenger hunt game for Technical University of Berlin - interactive map and information for students of TUB
Code aviable on [GitHub]; Click to [Play]







Talks

2025 An Overview of Softmax Attention and Efficient Variants
Berlin-Leipzig online Seminar SS25: Mathematics of Machine Learning
Seminar [Link] Presentation [PDF]

2025 Numerical Methods for Kernel Slicing
Summer school Technical University of Chemnitz
Summer school [Link] Presentation [PDF]

2025 Slicing of Radial Functions: a Dimension Walk in the Fourier Space
Mathematical Signal and Image Analysis Conference - TUM Science & Study Center Raitenhaslach, Burghausen, Germany
Conference [Link] presentation [PDF]

2024 Wasserstein gradient flows for Riesz MMD regularized f-divergences
Summer school Technical University of Chemnitz
Summer school [Link] presentation [PDF]

2026 Quasi Linear Kernel Attention with Infinite Capacity
___
presentation [PDF]