select subsets of input points. Thereby, wefor the f i rst time propose an end-to-end learnable and task-agnostic sampling operation, named Gumbel Subset Sam-pling(GSS),toselectarepresentativesubsetofinputpoints.Equipped with Gumbel-Softmax, it produces a ”soft” con-tinuous subset in training...