Uploaded image for project: 'Periscope'
  1. Periscope
  2. MGNLPER-106

Cleanup the ranking workspace when changing the neural network size

    XMLWordPrintable

Details

    • Task
    • Resolution: Obsolete
    • Neutral
    • None
    • None
    • None

    Description

      When changing the outputUnits value (for instance from default 10000 to 1000) in order to reduce NN size, if one doesn't cleanup the ranking workspace, an exception similar to the following will show in the logs upon selecting one search result.

      This is because the neural network loaded in memory was created with the previous configuration which doesn't match the new one.

      2019-03-21 12:32:53,293 ERROR gnolia.periscope.rank.ml.NeuralNetworkResultRanker: Failed to train ranking neural network
      *java.lang.IllegalArgumentException: Labels and preOutput must have equal shapes: got shapes [1, 10000] vs [1, 1000]*
      	at org.nd4j.base.Preconditions.throwEx(Preconditions.java:636) ~[nd4j-common-1.0.0-beta3.jar:?]
      	at org.nd4j.linalg.lossfunctions.impl.LossMCXENT.computeGradient(LossMCXENT.java:155) ~[nd4j-api-1.0.0-beta3.jar:1.0.0-beta3]
      

      Checklists

        Acceptance criteria

        Attachments

          Issue Links

            Activity

              People

                Unassigned Unassigned
                slutz Simon Lutz
                AuthorX
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Checklists

                    Task DoR