Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info

AI tagging relies on AWS Bedrock service.
An esaas operation is required to authorize the wedia application to consume bedrock services

...

Table of Contents
stylenone

Environment requirements

To enable AI tagging, additional configuration is required

  • AWS configuration

  • Application parameters

AWS configuration

Bedrock service access grants

The AWS account used by the application must have the following permission allowed: AmazonBedrockFullAccess

Code Block
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "BedrockAll",
            "Effect": "Allow",
            "Action": [
                "bedrock:*"
            ],
            "Resource": "*"
        },
        {
            "Sid": "DescribeKey",
            "Effect": "Allow",
            "Action": [
                "kms:DescribeKey"
            ],
            "Resource": "arn:*:kms:*:::*"
        },
        {
            "Sid": "APIsWithAllResourceAccess",
            "Effect": "Allow",
            "Action": [
                "iam:ListRoles",
                "ec2:DescribeVpcs",
                "ec2:DescribeSubnets",
                "ec2:DescribeSecurityGroups"
            ],
            "Resource": "*"
        },
        {
            "Sid": "PassRoleToBedrock",
            "Effect": "Allow",
            "Action": [
                "iam:PassRole"
            ],
            "Resource": "arn:aws:iam::*:role/*AmazonBedrock*",
            "Condition": {
                "StringEquals": {
                    "iam:PassedToService": [
                        "bedrock.amazonaws.com"
                    ]
                }
            }
        }
    ]
}
Model access

Request access to Anthropic models.

Note

Models might not be available in your zone. eu-west-3 is the preferred zone for requesting access.

...

Application parameters

As of 2024.3.0, the application configuration admin_config_family_mediacloud section must be filled (use dummy data)

...

Plugin PACKAGED_LLM

Using a Developper connected user, browse to plugin PACKAGED_LLM

...

Plugin PACKAGED_LLM

Activate plugin, then from URLs tab, click on url.index (/_plugins/PACKAGED_LLM/page/config.jspz)

This will open a small crappy UI allowing you to setup the plugin integration. image-20240702-073851.pngImage Removed

Configure your prompt

You need to configure the prompt that will be applied to describe images. The default value is “Describe this image”

...

Most of claude3 options should be configurable from the application.

The [Image] div box with dotted border represents the image that will be analyzedanalysed.

If you bookmark a configuration, it will be available in the History, from which you will be able to load from.

Info

The prompt is stored in appconfigs/poc_multimodal folder.

Test your prompt

You can use the Prompt entry from the menu to make some tests with a specific image, before configuring it.

...

Batch Test

You can also use Test entry to upload a set of images from the test screen to check your prompt among multiple images

...

Activate on the FO application

If you are managing the FO application configuration (json) on the server, you can define this configuration from the same UI

...

The configuration is stored on the customer layer of the configuration:

image-20240702-073122.png

FO application integration

If your client FO application configuration is not resolved by the server, you can activate the feature by adding to $.features

Code Block
languagejson
{
  "pocAiCaption": true,
  "pocAiCaption": "<FIELD_NAME>"
}

Results

...