Install Private GPT library in your PC, train AI Models and Chat with your private docs offline

-


Private GPT helps you to Ingest your documents and get answers of your questions from your documents, locally/offline. We can implement the PrivateGPT using GitHub open source library called "privateGPT". Following is the the url to access the library which contains completed implementation details including prerequisite like system requirement, software required to run the code.

https://github.com/imartinez/privateGPT

Using Private GPT library we can query the offline documents without need of internet however while setup we required to connect to the internet. In this article i going to show you how to implement the PrivateGPT in your PC.

Following is the list of software to be installed in the PC before installing the PrivateGPT.

  • Visual Studio Code
  • latest GIT
  • Latest Python
  • Visual Studio 2022 (Make sure you select Universal Windows Platform development, C++ CMake tools for Windows components while installing)
  • MinGW installer with gcc component

Once you install the above software into your PC you need to copy the PrivateGPT GitHub repository url available in above GitHub repository link. open visual studio code and go to the View >>Terminal then go to the location where you want to download the PrivateGPT code using cd command and enter the below command.

 git clone https://github.com/imartinez/privateGPT.git 
 
 
 git clone PrivateGPT 


Once your code gets downloaded then in visual studio code and in menu bar go to File>>Open Folder then select the privateGPT folder which you have downloaded from git as follows.

 

open PrivateGPT 
 
 
open PrivateGPT 2 
 
 
 
 
open PrivateGPT 3 
 

PrivateGPT folder

Now you can see the folder structure of the private GPT application as above. Now we need to download the model from the url provided in the PRivateGPT GitHub Repository link provided above. Once you download the file then create the folder named "Models"in root directory of PrivateGPT application and past the model file  as shown in below figure.

PrivateGPT Models

Now go to the View >>Terminal and you will be able to run power shell command in the terminal.

terminal 1


terminal 2
 

Now rename example.env file to .env as shown in below figure.
 

env setup 1

 
env setup 2


Now you need to enter below command to install the required components for running the privateGPT. Please remember on this command it requires internet connection to download the necessary files.

 pip3 install -r requirements.txt
privateGPT install


 

Once the component downloading and installing done the you need to enter following command to train the models with your local documents which is resides in source_documents folder. This command will take some time depending upon the size of your docs.

 python ingest.py


doc ingest


Once the ingest command finishes we are good to go for running privateGPT application, enter below command to run the application and chat with it.


 python privateGPT.py


privateGPT run 1 
 
 
privateGPT run 2

in above figure i have queried "what is inheritance with example" and following is the output of the query.

privateGPT run 1result

Following is the time taken to get the results for above query it will depending upon the hardware you have in your PC, if you have better hardware then this time can be reduce.

privateGPT run 2 result

and following figure shows the source documents from where the privateGPT found the answer.

privateGPT run 3 result

That's it you have successfully implemented the PrivateGPT in your PC.


Comments

Post a Comment

Popular posts from this blog

Implement Logging in CSV file using Nlog in .net core MVC application- part 2

-
Image
In previous article " Implement Nlog in .Net core MVC application part 1 "  I have demonstrated how we can implement basic setup of NLog in .core mvc application. In previous article we have logged the exceptions in flat file system. In this article I will show you how you can write the exception and custom logs in csv file. Writing logs in csv file can enable us better readability of logs in tabular form.       Lets start the implementation of it, I going to use the same example project used in previous demonstration. Modify the Nlog.config file as follows, added new target and rule for logging logs in csv file. <?xml version="1.0" encoding="utf-8" ?> <nlog xmlns="http://www.nlog-project.org/schemas/NLog.xsd" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.nlog-project.org/schemas/NLog.xsd NLog.xsd" autoReload="true" throwExceptions="fal
Read more

Implement Nlog in .Net core MVC application part 1

-
Image
Logging is a very important part of the enterprise application/web application. Setting up the logging correctly not only beneficial for long term maintenance of the application but also it is useful tool to find out the RCA in case of mission critical bug arises. Therefor we will going to discuss the various logging technique implementation using Nlog library package. In this article we will going to use .net core application for demonstration but you can implement it in .net framework application also. So lets start the implementation of Nlog in .net core MVC application. Open visual studio 2019/17 and create the new project as shown below.     Select Asp.net core Web App (Model-View-Controller) and provide the project name in project name text box.   Now on next screen click on create button this will create MVC app with .net core Now go to solution explorer and right click on project and click on Manage Nuget Package. Now in Nuget package manager install below listed Nlog packages.
Read more

Angular User Session Timeout example step by step

-
Image
This functionality let the user know that their session is about to expire and that they would be logged out if they didn’t take action. I have written this functionality in Angular for my latest application.  If you are new to Angular 6 then read my article about Setting up Angular 6 step by step before jump to this article to get handy in Angular 6. Dealing with timers in Angular can be significantly different when using React components and subscriptions. The basic premises remains the same, though. We’ll have a service with a timer that will provide a Subject to which consumers of the service can subscribe. A React Subject provides an easy mechanism to trigger a “next” subscription to alert consumers that the timer has expired.   import { Injectable } from '@angular/core'; import { Observable, Subject, Subscription, BehaviorSubject} from 'rxjs/Rx'; @Injectable() export class IdleTimeoutService { private _count: number = 0;
Read more

Devexpress Datebox date formatting in angular 6 with example

-
The Devexpress DateBox in Angular is a widget that displays the date and time in one of DevExtreme predefined formats or a format defined in an external localization library, or a type in the required date/time value. In this article, the i will provide you different date-format which we can set on DateBox to show date and time to user. Following is the code snippet to add Datebox in your Angular form if the you want to capture only date      <dx-date-box [value]="now" displayFormat="EEEE, MMM dd" type="date" > </dx-date-box> Following is the custom formats we can set and depending upon its converted values will be shown. "dd-MM-yyyy" => 28-10-2018 "EEEE, MMM dd" => Sunday, Oct 28 "dd MMM yyyy EEEE" => 28 Oct 2018 Sunday "dd-MM-yyyy EEEE" => 28-10-2018 Sunday alternatively you can change the format as way you want Following is
Read more

Restore the lost focus of Auto post back controls in asp.net update Panel control

-
Problem: We put  autopostback controls like textbox, DropDownList controls inside in update panel to reducing the flickering of the Page.but when user uses tab for entering the details  the focus of the control losts. Web site users who prefer to use keyboard need to use mouse to activate appropriate input box or press TAB multiple times. Solution: Step 1: Save following in js file give any name to it (like MyUpdatePanelFocus.js ) var lastFocusedControlId = ""; function focusHandler(e) { document.activeElement = e.originalTarget; } function appInit() { if (typeof (window.addEventListener) !== "undefined") { window.addEventListener("focus", focusHandler, true); } Sys.WebForms.PageRequestManager.getInstance().add_pageLoading(pageLoadingHandler); Sys.WebForms.PageRequestManager.getInstance().add_pageLoaded(pageLoadedHandler); } function pageLoadingHandler(sender, args) { lastFocusedControlId = typeof (document.acti
Read more