{"id":4708,"date":"2024-03-01T17:41:28","date_gmt":"2024-03-01T17:41:28","guid":{"rendered":"https:\/\/www.patentclaimmaster.com\/blog\/?p=4708"},"modified":"2025-04-23T19:19:12","modified_gmt":"2025-04-23T19:19:12","slug":"using-private-gpt-models","status":"publish","type":"post","link":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/","title":{"rendered":"Using private GPT models and local LLMs with ClaimMaster"},"content":{"rendered":"\n<p>If you have your own account with OpenAI, Azure OpenAI or have installed a local LLM, ClaimMaster lets you pass your API account information for completing GPT\/LLM prompts using your private GPT models (you&#8217;ll incur your own costs for the generated text). You may find this option beneficial as you&#8217;ll be able to use your custom end-points (Azure) or more advanced GPT models (ClaimMaster currently uses gpt-4o by default), as well as set the max limit on the tokens to generate more text than allowed ClaimMaster&#8217;s default settings.<\/p>\n\n\n\n<p>In addition, you can connect ClaimMaster to a local LLM, so that your data remains completely private and is not sent to the cloud for processing.  Note that doing so requires you to install a program, such as <a href=\"https:\/\/ollama.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Ollama<\/a>, <a href=\"https:\/\/lmstudio.ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">LM Studio<\/a> or <a href=\"https:\/\/gpt4all.io\/index.html\" target=\"_blank\" rel=\"noreferrer noopener\">GPT4All<\/a>, that can execute quantized\/compressed LLMs on your computer. While running LLMs locally might be slower and generates less finessed text than OpenAI GPT, for many cases it can be \u201cgood enough,\u201d especially when used for re-writing existing text.  In addition, open source LLMs are improving quickly and newer LLM models, such as Meta&#8217;s LLama3 are said to rival GPT.  So if you have data privacy concerns about cloud-based OpenAI\/Azure GPT applications, using such a local LLM in combination with ClaimMaster is an excellent alternative to GPT that lets you have a completely private AI-enhanced patent drafting solution. It\u2019s free, secure, and lets you access a number of powerful open-source LLMs to help with patent drafting. All you really need is a reasonably modern PC to run Ollama smoothly.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"ClaimMaster GPT\/LLM patent drafting tools\" width=\"1080\" height=\"608\" src=\"https:\/\/www.youtube.com\/embed\/XoSPxVw4wko?start=582&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<div class=\"schema-how-to wp-block-yoast-how-to-block\"><p class=\"schema-how-to-description\"><\/p> <ol class=\"schema-how-to-steps\"><li class=\"schema-how-to-step\" id=\"how-to-step-1709315134142\"><strong class=\"schema-how-to-step-name\">Set up the desired GPT\/LLM account<\/strong> <p class=\"schema-how-to-step-text\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-info-color\">a. <strong><span style=\"text-decoration: underline;\">OpenAI<\/span><\/strong><\/mark><br\/>Create an\u00a0<a href=\"https:\/\/platform.openai.com\/signup\">OpenAI account<\/a>\u00a0or\u00a0<a href=\"https:\/\/platform.openai.com\/login\">sign in<\/a>.  Then navigate to the\u00a0<a href=\"https:\/\/platform.openai.com\/account\/api-keys\">API key page<\/a>\u00a0and &#8220;<strong>Create new secret key<\/strong>&#8220;, optionally naming the key. Make sure to save this somewhere safe and do not share it with anyone<br\/><br\/><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-info-color\">b. <strong><span style=\"text-decoration: underline;\">Azure<\/span><\/strong><\/mark><br\/><a href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/ai-services\/openai\/quickstart?tabs=command-line%2Cpython&amp;pivots=rest-api#:~:text=An%20Azure%20subscription%20%2D-,Create%20one%20for%20free,-Access%20granted%20to\" target=\"_blank\" rel=\"noreferrer noopener\">Get an Azure subscription<\/a>, if you don&#8217;t have it (it&#8217;s free. Create and deploy <a href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/ai-services\/openai\/how-to\/create-resource?pivots=web-portal\" target=\"_blank\" rel=\"noreferrer noopener\">Azure GPT service<\/a>.<br\/><br\/><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-info-color\">c. <strong><span style=\"text-decoration: underline;\">Local LLM<\/span><\/strong><\/mark><br\/>Install a program allowing you to run local LLMs in server mode, such as <a href=\"https:\/\/ollama.com\/download\/windows\">Ollama <\/a>or <a href=\"https:\/\/lmstudio.ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">LM Studio<\/a>. Also download and install one of the LLMs, such as Llama3 or Mistral, using that program.  For more information installing and configuring ClaimMaster specifically with <a href=\"https:\/\/ollama.com\/download\/windows\">Ollama<\/a>, please see <a href=\"https:\/\/www.patentclaimmaster.com\/blog\/patent-drafting-local-generative-ai\">this post<\/a>. For the best results, it&#8217;s recommended to install these programs on a modern PC with Windows 10\/11, a 4 or 8-core processor, an SSD with 12-50 GB of free space for models, and plenty of RAM (8GB is the bare minimum but 16+ GB is really recommended).\u00a0<br\/><\/p> <\/li><li class=\"schema-how-to-step\" id=\"how-to-step-1709315217390\"><strong class=\"schema-how-to-step-name\">Configure ClaimMaster to connect to the selected GPT\/LLM source<br\/><\/strong> <p class=\"schema-how-to-step-text\">Go to <strong>ClaimMaster->Preferences, Extra Tools, Help<\/strong> menu, then <strong>Preferences <\/strong>menu.  Click on <strong>Patent Drafting->GPT\/LLM Settings<\/strong>.  <br\/><br\/> <img loading=\"lazy\" decoding=\"async\" width=\"456\" height=\"240\" src=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/gpt_settings1.png\" class=\"attachment-full size-full\" alt=\"gpt_settings_selection\" style=\"max-width: 100%; height: auto;\" srcset=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/gpt_settings1.png 456w, https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/gpt_settings1-300x158.png 300w\" sizes=\"auto, (max-width: 456px) 100vw, 456px\" \/><br\/><br\/>Alternatively, you can open GPT\/LLM settings directly from the GPT tools window.<br\/><img loading=\"lazy\" decoding=\"async\" width=\"366\" height=\"177\" src=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/llm_settings.png\" class=\"attachment-full size-full\" alt=\"llm_settings\" style=\"max-width: 100%; height: auto;\" srcset=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/llm_settings.png 366w, https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/llm_settings-300x145.png 300w\" sizes=\"auto, (max-width: 366px) 100vw, 366px\" \/><br\/><br\/>Then, depending on the source, configure ClaimMaster GPT settings as follows to use private GPT models.<br\/><br\/><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-info-color\">a. <strong><span style=\"text-decoration: underline;\">OpenAI<\/span><\/strong><\/mark><br\/>Select <strong>OpenAI GPT<\/strong> as the source.   Copy &amp; paste your private API key into the <strong>API key<\/strong> section. You should also specify the <strong>Model <\/strong>to use and <strong>Maximum # of tokens<\/strong> <strong>limit <\/strong>for prompt and return responses.  You can leave the <strong>Endpoint or local address<\/strong> field blank.  <br\/><br\/><img loading=\"lazy\" decoding=\"async\" width=\"447\" height=\"337\" src=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/openai_settings.png\" class=\"attachment-full size-full\" alt=\"openai gpt settings\" style=\"max-width: 100%; height: auto;\" srcset=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/openai_settings.png 447w, https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/openai_settings-300x226.png 300w\" sizes=\"auto, (max-width: 447px) 100vw, 447px\" \/><br\/>Then press <strong>Save <\/strong>to save the settings.<br\/><br\/><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-info-color\">b. <strong><span style=\"text-decoration: underline;\">Azure<\/span><\/strong><\/mark><br\/>Select <strong>Microsoft Azure GPT<\/strong> as the source.  Specify your azure endpoint in the <strong>Endpoint or local address<\/strong> field. The endpoint should specify the full address, such as <strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-primary-color\">https:\/\/{YOUR_RESOURCE_NAME}.openai.azure.com\/openai\/deployments\/{YOUR_DEPLOYMENT_NAME}\/chat\/completions?api-version=2024-02-15-preview<\/mark><\/strong>.  In addition, copy &amp; paste your private API key into the <strong>API key<\/strong> section. You should also specify the <strong>Model <\/strong>to use and <strong>Maximum # of tokens<\/strong> <strong>limit <\/strong>for prompt and return responses. <br\/><br\/><img loading=\"lazy\" decoding=\"async\" width=\"447\" height=\"337\" src=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png\" class=\"attachment-full size-full\" alt=\"Azure GPT settings\" style=\"max-width: 100%; height: auto;\" srcset=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png 447w, https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings-300x226.png 300w\" sizes=\"auto, (max-width: 447px) 100vw, 447px\" \/><br\/>Then press <strong>Save <\/strong>to save the settings.<br\/><br\/><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-info-color\">c. <strong><span style=\"text-decoration: underline;\">Local LLM<\/span><\/strong><\/mark><br\/>To use ClaimMaster with a locally running LLM, make sure to start the local LLM via Ollama or LM Studio or a similar program in server mode.  From the program, obtain the server port\/address to use for the local LLM, as shown below.  <br\/><br\/>In the ClaimMaster&#8217;s LLM settings window, specify the following settings and then save them:<br\/>* \u201c<strong>Source<\/strong>\u201d should be set to\u00a0<strong>Local<\/strong> <strong>LLM<\/strong>.<br\/>* \u201c<strong>Endpoint<\/strong>\u201d should be set to default server address for the LLM application, which would be \u201c<strong>http:\/\/localhost:11434\/api\/generate<\/strong>\u201d for Ollama or &#8220;<strong>http:\/\/localhost:1235\/v1\/chat\/completion<\/strong>&#8221; for LM Studio.  You can use the pre-defined drop-down option.  Please consult your program&#8217;s documentation for specific address instructions if using another LLM application.<br\/>* \u201c<strong>Model<\/strong>\u201d should be set to \u201c<strong>llama3\u2033, \u201cmistral\u201d, \u201cllava<\/strong>\u201d or any other model that you\u2019ve downloaded and installed via Ollama and want to use for patent drafting.<br\/><br\/><img loading=\"lazy\" decoding=\"async\" width=\"450\" height=\"335\" src=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/04\/ollama_cm.jpg\" class=\"attachment-450x335.06493506494 size-450x335.06493506494\" alt=\"ollama claimmaster\" srcset=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/04\/ollama_cm.jpg 462w, https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/04\/ollama_cm-300x223.jpg 300w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><br\/><br\/>You can ignore other fields in the GPT\/LLM settings window, since they are typically not used by the LLM program. Press <strong>Save <\/strong>to save the settings.<\/p> <\/li><li class=\"schema-how-to-step\" id=\"how-to-step-1709315248167\"><strong class=\"schema-how-to-step-name\">Send your prompts to the configured GPT\/LLM source<\/strong> <p class=\"schema-how-to-step-text\">Once your GPT\/LLM settings are configured, you can start using ClaimMaster to send your prompts to the private GPT models or local LLM, as explained in other tutorials.<br\/><img loading=\"lazy\" decoding=\"async\" width=\"381\" height=\"202\" src=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/send-prompt-to-gpt.png\" class=\"attachment-full size-full\" alt=\"\" style=\"max-width: 100%; height: auto;\" srcset=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/send-prompt-to-gpt.png 381w, https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/send-prompt-to-gpt-300x159.png 300w\" sizes=\"auto, (max-width: 381px) 100vw, 381px\" \/><\/p> <\/li><\/ol><\/div>\n\n\n\n<p><\/p>\n\n\n\n<p>For more information about this feature, check out the <a href=\"https:\/\/www.patentclaimmaster.com\/help\/Generatefiguredescriptionblocks.html\" target=\"_blank\" rel=\"noreferrer noopener\">Online Manual.<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.<\/p>\n","protected":false},"author":1,"featured_media":4810,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[1742,19],"class_list":["post-4708","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-know-how","tag-new-release","tag-patent-drafting-tools"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.6 (Yoast SEO v28.5) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Using private GPT models and local LLMs with ClaimMaster - ClaimMaster Software<\/title>\n<meta name=\"description\" content=\"ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Using private GPT models and local LLMs with ClaimMaster\" \/>\n<meta property=\"og:description\" content=\"ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/\" \/>\n<meta property=\"og:site_name\" content=\"ClaimMaster Software\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/home.php#%21%2fpages%2fClaimMaster%2f146814495334003%3fref%3dsgm\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-01T17:41:28+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-23T19:19:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png\" \/>\n\t<meta property=\"og:image:width\" content=\"447\" \/>\n\t<meta property=\"og:image:height\" content=\"337\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"claimmaster\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ClaimMaster\" \/>\n<meta name=\"twitter:site\" content=\"@ClaimMaster\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"claimmaster\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/\"},\"author\":{\"name\":\"claimmaster\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#\\\/schema\\\/person\\\/8c68201b55660ea55029d5579bfd8e0d\"},\"headline\":\"Using private GPT models and local LLMs with ClaimMaster\",\"datePublished\":\"2024-03-01T17:41:28+00:00\",\"dateModified\":\"2025-04-23T19:19:12+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/\"},\"wordCount\":865,\"publisher\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/azure_settings.png\",\"keywords\":[\"New Release\",\"Patent Drafting Tools\"],\"articleSection\":[\"Know How\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/\",\"name\":\"Using private GPT models and local LLMs with ClaimMaster - ClaimMaster Software\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/azure_settings.png\",\"datePublished\":\"2024-03-01T17:41:28+00:00\",\"dateModified\":\"2025-04-23T19:19:12+00:00\",\"description\":\"ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/azure_settings.png\",\"contentUrl\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/azure_settings.png\",\"width\":447,\"height\":337,\"caption\":\"Azure GPT settings\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Know How\",\"item\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/category\\\/know-how\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Using private GPT models and local LLMs with ClaimMaster\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/\",\"name\":\"ClaimMaster Software\",\"description\":\"Tools for patent proofreading, patent drafting, document automation, and patent analysis\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#organization\",\"name\":\"ClaimMaster Software LLC\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/05\\\/logo-small.png\",\"contentUrl\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/05\\\/logo-small.png\",\"width\":117,\"height\":15,\"caption\":\"ClaimMaster Software LLC\"},\"image\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"http:\\\/\\\/www.facebook.com\\\/home.php#!\\\/pages\\\/ClaimMaster\\\/146814495334003?ref=sgm\",\"https:\\\/\\\/x.com\\\/ClaimMaster\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/3158822\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/#\\\/schema\\\/person\\\/8c68201b55660ea55029d5579bfd8e0d\",\"name\":\"claimmaster\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a4abfa2ed4aabad1365faed0f2fa0d1f670c27cb5185211d049683ac16203d18?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a4abfa2ed4aabad1365faed0f2fa0d1f670c27cb5185211d049683ac16203d18?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a4abfa2ed4aabad1365faed0f2fa0d1f670c27cb5185211d049683ac16203d18?s=96&d=mm&r=g\",\"caption\":\"claimmaster\"}},{\"@type\":\"HowTo\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#howto-1\",\"name\":\"Using private GPT models and local LLMs with ClaimMaster\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#article\"},\"description\":\"\",\"step\":[{\"@type\":\"HowToStep\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#how-to-step-1709315134142\",\"name\":\"Set up the desired GPT\\\/LLM account\",\"itemListElement\":[{\"@type\":\"HowToDirection\",\"text\":\"a. OpenAICreate an\u00a0OpenAI account\u00a0or\u00a0sign in.  Then navigate to the\u00a0API key page\u00a0and \\\"Create new secret key\\\", optionally naming the key. Make sure to save this somewhere safe and do not share it with anyoneb. AzureGet an Azure subscription, if you don't have it (it's free. Create and deploy Azure GPT service.c. Local LLMInstall a program allowing you to run local LLMs in server mode, such as Ollama or LM Studio. Also download and install one of the LLMs, such as Llama3 or Mistral, using that program.  For more information installing and configuring ClaimMaster specifically with Ollama, please see this post. For the best results, it's recommended to install these programs on a modern PC with Windows 10\\\/11, a 4 or 8-core processor, an SSD with 12-50 GB of free space for models, and plenty of RAM (8GB is the bare minimum but 16+ GB is really recommended).\u00a0\"}]},{\"@type\":\"HowToStep\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#how-to-step-1709315217390\",\"name\":\"Configure ClaimMaster to connect to the selected GPT\\\/LLM source\",\"itemListElement\":[{\"@type\":\"HowToDirection\",\"text\":\"Go to ClaimMaster->Preferences, Extra Tools, Help menu, then Preferences menu.  Click on Patent Drafting->GPT\\\/LLM Settings.   Alternatively, you can open GPT\\\/LLM settings directly from the GPT tools window.Then, depending on the source, configure ClaimMaster GPT settings as follows to use private GPT models.a. OpenAISelect OpenAI GPT as the source.   Copy & paste your private API key into the API key section. You should also specify the Model to use and Maximum # of tokens limit for prompt and return responses.  You can leave the Endpoint or local address field blank.  Then press Save to save the settings.b. AzureSelect Microsoft Azure GPT as the source.  Specify your azure endpoint in the Endpoint or local address field. The endpoint should specify the full address, such as https:\\\/\\\/{YOUR_RESOURCE_NAME}.openai.azure.com\\\/openai\\\/deployments\\\/{YOUR_DEPLOYMENT_NAME}\\\/chat\\\/completions?api-version=2024-02-15-preview.  In addition, copy & paste your private API key into the API key section. You should also specify the Model to use and Maximum # of tokens limit for prompt and return responses. Then press Save to save the settings.c. Local LLMTo use ClaimMaster with a locally running LLM, make sure to start the local LLM via Ollama or LM Studio or a similar program in server mode.  From the program, obtain the server port\\\/address to use for the local LLM, as shown below.  In the ClaimMaster's LLM settings window, specify the following settings and then save them:* \u201cSource\u201d should be set to\u00a0Local LLM.* \u201cEndpoint\u201d should be set to default server address for the LLM application, which would be \u201chttp:\\\/\\\/localhost:11434\\\/api\\\/generate\u201d for Ollama or \\\"http:\\\/\\\/localhost:1235\\\/v1\\\/chat\\\/completion\\\" for LM Studio.  You can use the pre-defined drop-down option.  Please consult your program's documentation for specific address instructions if using another LLM application.* \u201cModel\u201d should be set to \u201cllama3\u2033, \u201cmistral\u201d, \u201cllava\u201d or any other model that you\u2019ve downloaded and installed via Ollama and want to use for patent drafting.You can ignore other fields in the GPT\\\/LLM settings window, since they are typically not used by the LLM program. Press Save to save the settings.\"}],\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#schema-image-d31b127a9e8c8bd99af5c1a08c29572a\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/ollama_cm.jpg\",\"contentUrl\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/ollama_cm.jpg\",\"width\":462,\"height\":344,\"caption\":\"ollama claimmaster\"}},{\"@type\":\"HowToStep\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#how-to-step-1709315248167\",\"name\":\"Send your prompts to the configured GPT\\\/LLM source\",\"itemListElement\":[{\"@type\":\"HowToDirection\",\"text\":\"Once your GPT\\\/LLM settings are configured, you can start using ClaimMaster to send your prompts to the private GPT models or local LLM, as explained in other tutorials.\"}],\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/using-private-gpt-models\\\/#schema-image-51dad1447f1372dbf03608dfd8ae4cfd\",\"url\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/send-prompt-to-gpt.png\",\"contentUrl\":\"https:\\\/\\\/www.patentclaimmaster.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/send-prompt-to-gpt.png\",\"width\":381,\"height\":202}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Using private GPT models and local LLMs with ClaimMaster - ClaimMaster Software","description":"ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/","og_locale":"en_US","og_type":"article","og_title":"Using private GPT models and local LLMs with ClaimMaster","og_description":"ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.","og_url":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/","og_site_name":"ClaimMaster Software","article_publisher":"http:\/\/www.facebook.com\/home.php#%21%2fpages%2fClaimMaster%2f146814495334003%3fref%3dsgm","article_published_time":"2024-03-01T17:41:28+00:00","article_modified_time":"2025-04-23T19:19:12+00:00","og_image":[{"width":447,"height":337,"url":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png","type":"image\/png"}],"author":"claimmaster","twitter_card":"summary_large_image","twitter_creator":"@ClaimMaster","twitter_site":"@ClaimMaster","twitter_misc":{"Written by":"claimmaster","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#article","isPartOf":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/"},"author":{"name":"claimmaster","@id":"https:\/\/www.patentclaimmaster.com\/blog\/#\/schema\/person\/8c68201b55660ea55029d5579bfd8e0d"},"headline":"Using private GPT models and local LLMs with ClaimMaster","datePublished":"2024-03-01T17:41:28+00:00","dateModified":"2025-04-23T19:19:12+00:00","mainEntityOfPage":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/"},"wordCount":865,"publisher":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png","keywords":["New Release","Patent Drafting Tools"],"articleSection":["Know How"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/","url":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/","name":"Using private GPT models and local LLMs with ClaimMaster - ClaimMaster Software","isPartOf":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#primaryimage"},"image":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png","datePublished":"2024-03-01T17:41:28+00:00","dateModified":"2025-04-23T19:19:12+00:00","description":"ClaimMaster lets you configure private GPT models or local LLM for use with its patent drafting and editing tools.","breadcrumb":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#primaryimage","url":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png","contentUrl":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/azure_settings.png","width":447,"height":337,"caption":"Azure GPT settings"},{"@type":"BreadcrumbList","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.patentclaimmaster.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Know How","item":"https:\/\/www.patentclaimmaster.com\/blog\/category\/know-how\/"},{"@type":"ListItem","position":3,"name":"Using private GPT models and local LLMs with ClaimMaster"}]},{"@type":"WebSite","@id":"https:\/\/www.patentclaimmaster.com\/blog\/#website","url":"https:\/\/www.patentclaimmaster.com\/blog\/","name":"ClaimMaster Software","description":"Tools for patent proofreading, patent drafting, document automation, and patent analysis","publisher":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.patentclaimmaster.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.patentclaimmaster.com\/blog\/#organization","name":"ClaimMaster Software LLC","url":"https:\/\/www.patentclaimmaster.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patentclaimmaster.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2020\/05\/logo-small.png","contentUrl":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2020\/05\/logo-small.png","width":117,"height":15,"caption":"ClaimMaster Software LLC"},"image":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/home.php#!\/pages\/ClaimMaster\/146814495334003?ref=sgm","https:\/\/x.com\/ClaimMaster","https:\/\/www.linkedin.com\/company\/3158822"]},{"@type":"Person","@id":"https:\/\/www.patentclaimmaster.com\/blog\/#\/schema\/person\/8c68201b55660ea55029d5579bfd8e0d","name":"claimmaster","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/a4abfa2ed4aabad1365faed0f2fa0d1f670c27cb5185211d049683ac16203d18?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/a4abfa2ed4aabad1365faed0f2fa0d1f670c27cb5185211d049683ac16203d18?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a4abfa2ed4aabad1365faed0f2fa0d1f670c27cb5185211d049683ac16203d18?s=96&d=mm&r=g","caption":"claimmaster"}},{"@type":"HowTo","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#howto-1","name":"Using private GPT models and local LLMs with ClaimMaster","mainEntityOfPage":{"@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#article"},"description":"","step":[{"@type":"HowToStep","url":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#how-to-step-1709315134142","name":"Set up the desired GPT\/LLM account","itemListElement":[{"@type":"HowToDirection","text":"a. OpenAICreate an\u00a0OpenAI account\u00a0or\u00a0sign in.  Then navigate to the\u00a0API key page\u00a0and \"Create new secret key\", optionally naming the key. Make sure to save this somewhere safe and do not share it with anyoneb. AzureGet an Azure subscription, if you don't have it (it's free. Create and deploy Azure GPT service.c. Local LLMInstall a program allowing you to run local LLMs in server mode, such as Ollama or LM Studio. Also download and install one of the LLMs, such as Llama3 or Mistral, using that program.  For more information installing and configuring ClaimMaster specifically with Ollama, please see this post. For the best results, it's recommended to install these programs on a modern PC with Windows 10\/11, a 4 or 8-core processor, an SSD with 12-50 GB of free space for models, and plenty of RAM (8GB is the bare minimum but 16+ GB is really recommended).\u00a0"}]},{"@type":"HowToStep","url":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#how-to-step-1709315217390","name":"Configure ClaimMaster to connect to the selected GPT\/LLM source","itemListElement":[{"@type":"HowToDirection","text":"Go to ClaimMaster->Preferences, Extra Tools, Help menu, then Preferences menu.  Click on Patent Drafting->GPT\/LLM Settings.   Alternatively, you can open GPT\/LLM settings directly from the GPT tools window.Then, depending on the source, configure ClaimMaster GPT settings as follows to use private GPT models.a. OpenAISelect OpenAI GPT as the source.   Copy & paste your private API key into the API key section. You should also specify the Model to use and Maximum # of tokens limit for prompt and return responses.  You can leave the Endpoint or local address field blank.  Then press Save to save the settings.b. AzureSelect Microsoft Azure GPT as the source.  Specify your azure endpoint in the Endpoint or local address field. The endpoint should specify the full address, such as https:\/\/{YOUR_RESOURCE_NAME}.openai.azure.com\/openai\/deployments\/{YOUR_DEPLOYMENT_NAME}\/chat\/completions?api-version=2024-02-15-preview.  In addition, copy & paste your private API key into the API key section. You should also specify the Model to use and Maximum # of tokens limit for prompt and return responses. Then press Save to save the settings.c. Local LLMTo use ClaimMaster with a locally running LLM, make sure to start the local LLM via Ollama or LM Studio or a similar program in server mode.  From the program, obtain the server port\/address to use for the local LLM, as shown below.  In the ClaimMaster's LLM settings window, specify the following settings and then save them:* \u201cSource\u201d should be set to\u00a0Local LLM.* \u201cEndpoint\u201d should be set to default server address for the LLM application, which would be \u201chttp:\/\/localhost:11434\/api\/generate\u201d for Ollama or \"http:\/\/localhost:1235\/v1\/chat\/completion\" for LM Studio.  You can use the pre-defined drop-down option.  Please consult your program's documentation for specific address instructions if using another LLM application.* \u201cModel\u201d should be set to \u201cllama3\u2033, \u201cmistral\u201d, \u201cllava\u201d or any other model that you\u2019ve downloaded and installed via Ollama and want to use for patent drafting.You can ignore other fields in the GPT\/LLM settings window, since they are typically not used by the LLM program. Press Save to save the settings."}],"image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#schema-image-d31b127a9e8c8bd99af5c1a08c29572a","url":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/04\/ollama_cm.jpg","contentUrl":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/04\/ollama_cm.jpg","width":462,"height":344,"caption":"ollama claimmaster"}},{"@type":"HowToStep","url":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#how-to-step-1709315248167","name":"Send your prompts to the configured GPT\/LLM source","itemListElement":[{"@type":"HowToDirection","text":"Once your GPT\/LLM settings are configured, you can start using ClaimMaster to send your prompts to the private GPT models or local LLM, as explained in other tutorials."}],"image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patentclaimmaster.com\/blog\/using-private-gpt-models\/#schema-image-51dad1447f1372dbf03608dfd8ae4cfd","url":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/send-prompt-to-gpt.png","contentUrl":"https:\/\/www.patentclaimmaster.com\/blog\/wp-content\/uploads\/2024\/03\/send-prompt-to-gpt.png","width":381,"height":202}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/posts\/4708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/comments?post=4708"}],"version-history":[{"count":33,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/posts\/4708\/revisions"}],"predecessor-version":[{"id":5603,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/posts\/4708\/revisions\/5603"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/media\/4810"}],"wp:attachment":[{"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/media?parent=4708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/categories?post=4708"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.patentclaimmaster.com\/blog\/wp-json\/wp\/v2\/tags?post=4708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}