Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Setup Probe for IsIdentifiable / NER daemons / test cases #1273

Open
tznind opened this issue Aug 19, 2022 · 1 comment
Open

Add Setup Probe for IsIdentifiable / NER daemons / test cases #1273

tznind opened this issue Aug 19, 2022 · 1 comment

Comments

@tznind
Copy link
Contributor

tznind commented Aug 19, 2022

Background

Setup verb was added to smi in #945 . It checks that required services are accessible (using details in config files) and that microservices are able to boot successfully. It supports both unattended (spectre console results table + zero/nonzero exit code) and interactive (terminal gui).

Enhancement

To prevent regressions in our NLP related features we should also add support for checking that:

  • Rules files exist
  • NLP daemons are running at the end of any SocketRule

Possible

  • Run 'deployment specific' test scripts (detect if environment has misbehaving dependencies or NLP that doesn't classify what we expect)
    • for given input text of A then the following problem data should be detected X,Y
    • might be easier to point this to a script e.g. in Python or something for finer grained asserts / test harness type stuff
@rkm
Copy link
Member

rkm commented Aug 19, 2022

The last point may not fit in this feature on second thought. We'll want to run a range of tests, not all via c#, so perhaps that aspect is better handled in a scripting language such as python.

This is tied to the dev/test environment, so this should become clearer as that work progresses

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants