no code implementations • NeurIPS Workshop AI4Scien 2021 • Rohan Singh Ghotra, Nicholas Keone Lee, Peter K Koo
A major goal of computational genomics is to understand how sequence patterns, called motifs, interact to regulate gene expression.
no code implementations • NeurIPS Workshop AI4Scien 2021 • Ethan Louis Labelson, Rohit Tripathy, Peter K Koo
In practice, gradient-based attribution methods, such as saliency maps, can yield noisy importance scores depending on model architecture and training procedure.
no code implementations • ICLR Workshop EBM 2021 • Nick Bhattacharya, Neil Thomas, Roshan Rao, Justas Daupras, Peter K Koo, David Baker, Yun S. Song, Sergey Ovchinnikov
On the one hand, factored attention is a direct simplification of multihead scaled dot-product attention in the Transformer.