Skip to content

Commit

Permalink
deploy: 0ba9027
Browse files Browse the repository at this point in the history
  • Loading branch information
NeuralChatBot committed Oct 30, 2024
1 parent 0ba9027 commit eb5ae65
Show file tree
Hide file tree
Showing 22 changed files with 36 additions and 36 deletions.
4 changes: 2 additions & 2 deletions latest/GenAIExamples/AudioQnA/kubernetes/intel/README.html
Original file line number Diff line number Diff line change
Expand Up @@ -885,7 +885,7 @@ <h1>Deploy AudioQnA in a Kubernetes Cluster<a class="headerlink" href="#deploy-a
</div></blockquote>
<section id="deploy-on-xeon">
<h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to this heading"></a></h2>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">AudioQnA</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifests</span>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">AudioQnA</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifest</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">audioqna</span><span class="o">.</span><span class="n">yaml</span>
<span class="n">kubectl</span> <span class="n">apply</span> <span class="o">-</span><span class="n">f</span> <span class="n">audioqna</span><span class="o">.</span><span class="n">yaml</span>
Expand All @@ -894,7 +894,7 @@ <h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to th
</section>
<section id="deploy-on-gaudi">
<h2>Deploy On Gaudi<a class="headerlink" href="#deploy-on-gaudi" title="Link to this heading"></a></h2>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">AudioQnA</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">hpu</span><span class="o">/</span><span class="n">gaudi</span><span class="o">/</span><span class="n">manifests</span>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">AudioQnA</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">hpu</span><span class="o">/</span><span class="n">gaudi</span><span class="o">/</span><span class="n">manifest</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">audioqna</span><span class="o">.</span><span class="n">yaml</span>
<span class="n">kubectl</span> <span class="n">apply</span> <span class="o">-</span><span class="n">f</span> <span class="n">audioqna</span><span class="o">.</span><span class="n">yaml</span>
Expand Down
4 changes: 2 additions & 2 deletions latest/GenAIExamples/CodeGen/kubernetes/intel/README.html
Original file line number Diff line number Diff line change
Expand Up @@ -887,7 +887,7 @@ <h1>Deploy CodeGen in Kubernetes Cluster<a class="headerlink" href="#deploy-code
</div></blockquote>
<section id="deploy-on-xeon">
<h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to this heading"></a></h2>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">CodeGen</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifests</span>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">CodeGen</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifest</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">export</span> <span class="n">MODEL_ID</span><span class="o">=</span><span class="s2">&quot;Qwen/Qwen2.5-Coder-7B-Instruct&quot;</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">codegen</span><span class="o">.</span><span class="n">yaml</span>
Expand All @@ -898,7 +898,7 @@ <h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to th
</section>
<section id="deploy-on-gaudi">
<h2>Deploy On Gaudi<a class="headerlink" href="#deploy-on-gaudi" title="Link to this heading"></a></h2>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">CodeGen</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">hpu</span><span class="o">/</span><span class="n">gaudi</span><span class="o">/</span><span class="n">manifests</span>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">CodeGen</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">hpu</span><span class="o">/</span><span class="n">gaudi</span><span class="o">/</span><span class="n">manifest</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">codegen</span><span class="o">.</span><span class="n">yaml</span>
<span class="n">kubectl</span> <span class="n">apply</span> <span class="o">-</span><span class="n">f</span> <span class="n">codegen</span><span class="o">.</span><span class="n">yaml</span>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -891,7 +891,7 @@ <h2>Prerequisites for Deploying CodeGen with ReactUI<a class="headerlink" href="
<p>a. HUGGINGFACEHUB_API_TOKEN (Your HuggingFace token to download your desired model from HuggingFace):</p>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="c1"># You may set the HUGGINGFACEHUB_API_TOKEN via method:</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">CodeGen</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifests</span><span class="o">/</span><span class="n">ui</span><span class="o">/</span>
<span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">CodeGen</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifest</span><span class="o">/</span><span class="n">ui</span><span class="o">/</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">react</span><span class="o">-</span><span class="n">codegen</span><span class="o">.</span><span class="n">yaml</span>
</pre></div>
</div>
Expand Down
4 changes: 2 additions & 2 deletions latest/GenAIExamples/CodeTrans/kubernetes/intel/README.html
Original file line number Diff line number Diff line change
Expand Up @@ -903,7 +903,7 @@ <h2>Required Models<a class="headerlink" href="#required-models" title="Link to
</section>
<section id="deploy-on-xeon">
<h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to this heading"></a></h2>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>GenAIExamples/CodeTrans/kubernetes/intel/cpu/xeon/manifests
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>GenAIExamples/CodeTrans/kubernetes/intel/cpu/xeon/manifest
<span class="nb">export</span><span class="w"> </span><span class="nv">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
sed<span class="w"> </span>-i<span class="w"> </span><span class="s2">&quot;s/insert-your-huggingface-token-here/</span><span class="si">${</span><span class="nv">HUGGINGFACEHUB_API_TOKEN</span><span class="si">}</span><span class="s2">/g&quot;</span><span class="w"> </span>codetrans.yaml
kubectl<span class="w"> </span>apply<span class="w"> </span>-f<span class="w"> </span>codetrans.yaml
Expand All @@ -912,7 +912,7 @@ <h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to th
</section>
<section id="deploy-on-gaudi">
<h2>Deploy On Gaudi<a class="headerlink" href="#deploy-on-gaudi" title="Link to this heading"></a></h2>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>GenAIExamples/CodeTrans/kubernetes/intel/hpu/gaudi/manifests
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>GenAIExamples/CodeTrans/kubernetes/intel/hpu/gaudi/manifest
<span class="nb">export</span><span class="w"> </span><span class="nv">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
sed<span class="w"> </span>-i<span class="w"> </span><span class="s2">&quot;s/insert-your-huggingface-token-here/</span><span class="si">${</span><span class="nv">HUGGINGFACEHUB_API_TOKEN</span><span class="si">}</span><span class="s2">/g&quot;</span><span class="w"> </span>codetrans.yaml
kubectl<span class="w"> </span>apply<span class="w"> </span>-f<span class="w"> </span>codetrans.yaml
Expand Down
4 changes: 2 additions & 2 deletions latest/GenAIExamples/DocSum/kubernetes/intel/README.html
Original file line number Diff line number Diff line change
Expand Up @@ -886,7 +886,7 @@ <h1>Deploy DocSum in Kubernetes Cluster<a class="headerlink" href="#deploy-docsu
</div></blockquote>
<section id="deploy-on-xeon">
<h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to this heading"></a></h2>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">DocSum</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifests</span>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">DocSum</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">cpu</span><span class="o">/</span><span class="n">xeon</span><span class="o">/</span><span class="n">manifest</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">docsum</span><span class="o">.</span><span class="n">yaml</span>
<span class="n">kubectl</span> <span class="n">apply</span> <span class="o">-</span><span class="n">f</span> <span class="n">docsum</span><span class="o">.</span><span class="n">yaml</span>
Expand All @@ -895,7 +895,7 @@ <h2>Deploy On Xeon<a class="headerlink" href="#deploy-on-xeon" title="Link to th
</section>
<section id="deploy-on-gaudi">
<h2>Deploy On Gaudi<a class="headerlink" href="#deploy-on-gaudi" title="Link to this heading"></a></h2>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">DocSum</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">hpu</span><span class="o">/</span><span class="n">gaudi</span><span class="o">/</span><span class="n">manifests</span>
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">cd</span> <span class="n">GenAIExamples</span><span class="o">/</span><span class="n">DocSum</span><span class="o">/</span><span class="n">kubernetes</span><span class="o">/</span><span class="n">intel</span><span class="o">/</span><span class="n">hpu</span><span class="o">/</span><span class="n">gaudi</span><span class="o">/</span><span class="n">manifest</span>
<span class="n">export</span> <span class="n">HUGGINGFACEHUB_API_TOKEN</span><span class="o">=</span><span class="s2">&quot;YourOwnToken&quot;</span>
<span class="n">sed</span> <span class="o">-</span><span class="n">i</span> <span class="s2">&quot;s/insert-your-huggingface-token-here/$</span><span class="si">{HUGGINGFACEHUB_API_TOKEN}</span><span class="s2">/g&quot;</span> <span class="n">docsum</span><span class="o">.</span><span class="n">yaml</span>
<span class="n">kubectl</span> <span class="n">apply</span> <span class="o">-</span><span class="n">f</span> <span class="n">docsum</span><span class="o">.</span><span class="n">yaml</span>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -889,7 +889,7 @@ <h2>Prerequisites for Deploying DocSum with ReactUI<a class="headerlink" href="#
<li><p>Kubernetes installation: Make sure that you have Kubernetes installed.</p></li>
<li><p>Configuration Values: Set the following values in react-docsum.yaml before proceeding with the deployment:
a. HUGGINGFACEHUB_API_TOKEN (Your HuggingFace token to download your desired model from HuggingFace):
<code class="docutils literal notranslate">&#160;&#160;&#160; <span class="pre">#</span> <span class="pre">You</span> <span class="pre">may</span> <span class="pre">set</span> <span class="pre">the</span> <span class="pre">HUGGINGFACEHUB_API_TOKEN</span> <span class="pre">via</span> <span class="pre">method:</span>&#160;&#160;&#160;&#160; <span class="pre">export</span> <span class="pre">HUGGINGFACEHUB_API_TOKEN=&quot;YourOwnToken&quot;</span>&#160;&#160;&#160;&#160; <span class="pre">cd</span> <span class="pre">GenAIExamples/DocSum/kubernetes/intel/cpu/xeon/manifests/ui/</span>&#160;&#160;&#160;&#160; <span class="pre">sed</span> <span class="pre">-i</span> <span class="pre">&quot;s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g&quot;</span> <span class="pre">react-docsum.yaml</span>&#160;&#160;&#160; </code>
<code class="docutils literal notranslate">&#160;&#160;&#160; <span class="pre">#</span> <span class="pre">You</span> <span class="pre">may</span> <span class="pre">set</span> <span class="pre">the</span> <span class="pre">HUGGINGFACEHUB_API_TOKEN</span> <span class="pre">via</span> <span class="pre">method:</span>&#160;&#160;&#160;&#160; <span class="pre">export</span> <span class="pre">HUGGINGFACEHUB_API_TOKEN=&quot;YourOwnToken&quot;</span>&#160;&#160;&#160;&#160; <span class="pre">cd</span> <span class="pre">GenAIExamples/DocSum/kubernetes/intel/cpu/xeon/manifest/ui/</span>&#160;&#160;&#160;&#160; <span class="pre">sed</span> <span class="pre">-i</span> <span class="pre">&quot;s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g&quot;</span> <span class="pre">react-docsum.yaml</span>&#160;&#160;&#160; </code>
b. Set the proxies based on your network configuration
<code class="docutils literal notranslate">&#160;&#160;&#160; <span class="pre">#</span> <span class="pre">Look</span> <span class="pre">for</span> <span class="pre">http_proxy,</span> <span class="pre">https_proxy,</span> <span class="pre">no_proxy</span> <span class="pre">key</span> <span class="pre">and</span> <span class="pre">fill</span> <span class="pre">up</span> <span class="pre">the</span> <span class="pre">value</span> <span class="pre">with</span> <span class="pre">your</span> <span class="pre">proxy</span> <span class="pre">configuration.</span>&#160;&#160;&#160; </code></p></li>
<li><p>MODEL_ID and model-volume (OPTIONAL): You may as well customize the “MODEL_ID” to use different model and model-volume for the volume to be mounted.</p></li>
Expand Down
Loading

0 comments on commit eb5ae65

Please sign in to comment.