Skip to main content

LoRA

Overview​

The LoRA is used to create image from text, using LoRA models, based on trained or on public models.

note

You can make an API call using your trained models or any public model by also passing the lora_model ID parameter.

You can find a list of the public and LoRA models available and their IDs here.

tip

You can also use multi Lora. Just make sure to pass comma saparated lora model ids to the lora_model as "more_details,animie" in the request body.

Request​

--request POST 'https://modelslab.com/api/v6/images/text2img' \

Make a POST request to https://modelslab.com/api/v6/images/text2img endpoint and pass the required parameters in the request body.

Body Attributes​

ParameterDescriptionValues
keyYour API Key used for request authorization.string
model_idThe ID of the model to be used. It can be a public model or your trained model.ID
promptA text description of the things you want in the generated image.string
negative_promptItems you don't want in the image.string
widthThe width of the image.Maximum value is 1024.
heightThe height of the image.Maximum value is 1024.
samplesNumber of images to be returned in response.Maximum value is 4.
num_inference_stepsNumber of denoising steps.values range from 1 to 20, and any value above 20 will be capped at 20.
safety_checkerA checker for NSFW images. If detected, such images will be replaced by a blank image.Default: "yes", Options: "yes"/"no"
enhance_promptEnhance prompts for better results.Default: "yes", Options: "yes"/"no"
seedUsed to reproduce results. The same seed will generate the same image again.Pass null for a random number.
guidance_scaleScale for classifier-free guidance.Minimum: 1, Maximum: 20
multi_lingualAllows multilingual prompts to generate images. Set to "yes" if using a language other than English in text prompts.Options: "yes"/"no"
panoramaSet to generate a panorama image.Options: "yes"/"no"
self_attentionSet for a high-quality image, though it will take more time.Options: "yes"/"no"
upscaleSet to upscale the image resolution two times (2x). If the requested resolution is 512 x 512 px, the generated image will be 1024 x 1024 px.Options: "yes"/"no"
embeddings_modelUse to pass an embeddings model (embeddings_model_id).ID
lora_modelPass LoRa model ID. Multiple LoRa models are supported; pass comma-separated values.ID
lora_strengthSpecify the strength of the LoRa model you're using. If using multiple LoRa models, provide each value as a comma-separated range.Range: minimum 0.1 to maximum 1
schedulerUse to set a scheduler.scheduler
webhookSet a URL to receive a POST API call once image generation is complete.URL
track_idID returned in the response to the webhook API call, used to identify the request.Integral value
clip_skipClip Skip.Minimum: 1, Maximum: 8
base64Get the response as a base64 string. Pass init_image, mask_image, and control_image as base64 strings to get a base64 response.Default: "no", Options: "yes"/"no"
tempCreate a temporary image link valid for 24 hours.Options: "yes"/"no"

Schedulers​

This endpoint also supports schedulers. Use the "scheduler" parameter in the request body to pass a specific scheduler from the list below:

  • DDPMScheduler
  • DDIMScheduler
  • PNDMScheduler
  • LMSDiscreteScheduler
  • EulerDiscreteScheduler
  • EulerAncestralDiscreteScheduler
  • DPMSolverMultistepScheduler
  • HeunDiscreteScheduler
  • KDPM2DiscreteScheduler
  • DPMSolverSinglestepScheduler
  • KDPM2AncestralDiscreteScheduler
  • UniPCMultistepScheduler
  • DDIMInverseScheduler
  • DEISMultistepScheduler
  • IPNDMScheduler
  • KarrasVeScheduler
  • ScoreSdeVeScheduler
  • LCMScheduler

Example​

Body​

Body
{
  "key": "",
  "model_id": "tamarin-xl-v1",
  "prompt": "actual 8K portrait photo of gareth person, portrait, happy colors, bright eyes, clear eyes, warm smile, smooth soft skin, big dreamy eyes, beautiful intricate colored hair, symmetrical, anime wide eyes, soft lighting, detailed face, by makoto shinkai, stanley artgerm lau, wlop, rossdraws, concept art, digital painting, looking into camera",
  "negative_prompt": "painting, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, deformed, ugly, blurry, bad anatomy, bad proportions, extra limbs, cloned face, skinny, glitchy, double torso, extra arms, extra hands, mangled fingers, missing lips, ugly face, distorted face, extra legs, anime",
  "width": "512",
  "height": "512",
  "samples": "1",
  "num_inference_steps": "31",
  "safety_checker": "no",
  "enhance_prompt": "yes",
  "seed": null,
  "guidance_scale": 7.5,
  "panorama": "no",
  "self_attention": "no",
  "upscale": "no",
  "lora_strength": "0.45",
  "lora_model": "xl-realistic-cake-art-sty",
  "scheduler": "UniPCMultistepScheduler",
  "webhook": null,
  "track_id": null
}

Request​

var myHeaders = new Headers();
myHeaders.append("Content-Type", "application/json");

var raw = JSON.stringify({
{
  "key": "",
  "model_id": "tamarin-xl-v1",
  "prompt": "actual 8K portrait photo of gareth person, portrait, happy colors, bright eyes, clear eyes, warm smile, smooth soft skin, big dreamy eyes, beautiful intricate colored hair, symmetrical, anime wide eyes, soft lighting, detailed face, by makoto shinkai, stanley artgerm lau, wlop, rossdraws, concept art, digital painting, looking into camera",
  "negative_prompt": "painting, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, deformed, ugly, blurry, bad anatomy, bad proportions, extra limbs, cloned face, skinny, glitchy, double torso, extra arms, extra hands, mangled fingers, missing lips, ugly face, distorted face, extra legs, anime",
  "width": "512",
  "height": "512",
  "samples": "1",
  "num_inference_steps": "31",
  "safety_checker": "no",
  "enhance_prompt": "yes",
  "seed": null,
  "guidance_scale": 7.5,
  "panorama": "no",
  "self_attention": "no",
  "upscale": "no",
  "lora_model": "xl-realistic-cake-art-sty",
  "lora_strength": "0.45",
  "scheduler": "UniPCMultistepScheduler",
  "webhook": null,
  "track_id": null
});

var requestOptions = {
  method: 'POST',
  headers: myHeaders,
  body: raw,
  redirect: 'follow'
};

fetch("https://modelslab.com/api/v6/images/text2img", requestOptions)
  .then(response => response.text())
  .then(result => console.log(result))
  .catch(error => console.log('error', error));

Response​

{
  "status": "success",
  "generationTime": 11.079592943191528,
    "id": 95120262,
    "output": ["https://pub-3626123a908346a7a8be8d9295f44e26.r2.dev/livewire-tmp/OQPx9DGoUYqLwjNu5nGR21ynuqDmjv-metaMC02NDRmMGViNy03N2JlLTRhZjYtODIwNi0zMzY0ZjU5ODYwMmJbMV0ucG5n-.png"],
    "meta": {
        "prompt": " actual 8K portrait photo of gareth person, portrait, happy colors, bright eyes, clear eyes, warm smile, smooth soft skin, big dreamy eyes, beautiful intricate colored hair, symmetrical, anime wide eyes, soft lighting, detailed face, by makoto shinkai, stanley artgerm lau, wlop, rossdraws, concept art, digital painting, looking into camera hyperrealistic, full body, detailed clothing, highly detailed, cinematic lighting, stunningly beautiful, intricate, sharp focus, f/1. 8, 85mm, (centered image composition), (professionally color graded), ((bright soft diffused light)), volumetric fog, trending on instagram, trending on tumblr, HDR 4K, 8K",
        "model_id": "tamarin-xl-v1",
        "negative_prompt": "painting, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, deformed, ugly, blurry, bad anatomy, bad proportions, extra limbs, cloned face, skinny, glitchy, double torso, extra arms, extra hands, mangled fingers, missing lips, ugly face, distorted face, extra legs, anime (child:1.5), ((((underage)))), ((((child)))), (((kid))), (((preteen))), (teen:1.5) ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, extra limbs, disfigured, deformed, body out of frame, bad anatomy, watermark, signature, cut off, low contrast, underexposed, overexposed, bad art, beginner, amateur, distorted face, blurry, draft, grainy",
        "scheduler": "UniPCMultistepScheduler",
        "safety_checker": "no",
        "W": 512,
        "H": 512,
        "guidance_scale": 7.5,
        "seed": 1224445153,
        "steps": 30,
        "n_samples": 1,
        "full_url": "no",
        "instant_response": "no",
        "tomesd": "no",
        "ip_adapter_id": null,
        "ip_adapter_scale": 0.6,
        "ip_adapter_image": null,
        "free_u": "no",
        "upscale": "no",
        "panorama": "no",
        "self_attention": "no",
        "use_karras_sigmas": "no",
        "algorithm_type": "no",
        "safety_checker_type": "sensitive_content_text",
        "embeddings": null,
        "vae": null,
        "lora": "xl-realistic-cake-art-sty",
        "lora_strength": "0.45",
        "clip_skip": 1,
        "temp": "no",
        "base64": "no",
        "file_prefix": "9418e305-3fa8-4b51-be96-bd58f4c09c9e.png"
    },
    
}