Search
English

Two-tower models for search and recommendation: fast retrieval with precomputation, trained by choosing wrong answers(zenn.dev)

startupxo Discuss

Writing language: KoreanRead in the original language

Plain summary

- A two-tower model has one neural network that reads the query or user information and another that reads the items to be searched. It multiplies the number lists (vectors) each produces to score how well they match. Items with higher scores are shown first. - Item-side vectors can be computed and stored in advance, so at search time only the query side needs to be computed. The author explains that this makes it efficient for searching large numbers of candidates. - In training, other correct items in the same batch are reused as wrong answers (negatives). The bias in which popular items are overused as negatives is corrected with their appearance probability (Yi et al. paper), and items that do not appear in the logs are supplemented with random negatives (Yang et al. paper). - On the method of using confusing negatives (hard negatives), the Facebook search paper (Huang et al.) reported that recall was best when using candidates ranked 101 to 500. At deployment, approximate search speeds things up but may miss some candidates.

Read source ↗

Found on

Zenn ↗ / Published by source

Have you run into something like this? Tell us in a line or two what you did. You do not need to know the product.

Sign in to comment

Keyboard shortcuts

Choose a post with J and K or the arrow keys, then press Enter.

K ↑ / J ↓
Previous post / next post
Enter C
Open summary and comments for the selected post
O
Open the original link of the selected post
/
Search
?
Show this help
Tab
Move to the submit or comment button, then press Enter

Type normally in text fields. Tab and Enter are always available.