Uploaded image for project: 'Periscope'
  1. Periscope
  2. MGNLPER-6

Research: Adapt neural network to changing the size of the result set; improve performance

    XMLWordPrintable

Details

    • New Feature
    • Resolution: Done
    • Neutral
    • 1.0
    • None
    • None
    • Basel 160, Basel 161
    • 5

    Description

      Currently neural network doesn't adjust itself to changing result set however, we should be considering the fact that result set typically changes over time and thus this case should be handled properly.

      Acceptance criteria / Research outcome:

      • Decision if we should set a fixed limit for the result set, such as 100,000 items.
        • Proposal what that limit should be.
        • Try if integer.maximum works.
        • Find a graceful fallback once all output units are "used up" (ideally forgetting old/irrelevant ones).
      • Improve performance, potentially by reducing the overall number of units (both in hidden layers and above-mentioned output layer).
      • Improve neural network storage performance
        • Debounce storage; only store once per time unit (default to e.g. 2 mins).
        • Assure proper synchronization on storage operations.
      • Timebox research to 5 SP.

      Checklists

        Acceptance criteria

        Attachments

          Issue Links

            Activity

              People

                creichenbach Cedric Reichenbach
                ilgun Ilgun Ilgun
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved: