Reference / Reference

Supported file types

A Duvi agent answers from text. This page lists every format Duvi extracts text from, the formats that fail silently, and the storage you get.

Supported formats

Duvi decides the format from the file type your browser reports, and from the extension when that is missing.

ExtensionWhat Duvi extracts
.pdfThe text layer. Nothing is read from a page that holds only an image of words.
.docxThe document text. Styling, headers and footers are dropped.
.html, .htmVisible body text. Scripts, styles and markup are stripped out.
.txt, .mdThe file, as written.
.json, .csvThe raw text. Duvi does not interpret structure, so a CSV is read as lines rather than as rows and columns.

Duvi reads anything not listed as plain text. That is correct for a text file under an unfamiliar extension and wrong for a compressed format, which the next section covers.

Formats that index as nothing

These files upload and appear in your library. They index as nothing, and the agent then answers as though the file was never added.

FileWhyWhat to do instead
A scanned PDFPictures of words carry no text layer. Open it and try to select a sentence: if nothing highlights, there is nothing to read.Run it through OCR and upload the result.
.xlsx, .pptxBoth are compressed archives, so reading them as text produces nothing usable.Export to .csv or .pdf first.
.doc, .rtfOlder Word formats. Duvi hands them to the modern Word reader, which usually cannot open them.Save as .docx.
ImagesDuvi does not read a standalone image file. It does describe images found while crawling a website.Put the picture on a page and add the page as a website source.
Password-protected filesDuvi cannot open them.Remove the password and upload again.

Storage limits

LimitValue
Storage per account5 GB
Size of any one fileNo separate cap. A single file may use the whole allowance.
File nameAnything without a /.

Duvi counts the allowance once per stored file, not once per agent that uses it, so attaching the same document to six agents costs the space of one. An upload that would take you over the limit is refused when it starts rather than part way through.

Removing a file from an agent frees nothing. Deleting it from the library is what returns the space. See Files.

Web pages

Duvi reads a website source with a crawler rather than a parser, so different rules apply. The crawler renders each page in a real browser, which captures content drawn by JavaScript, and it describes the images it finds so the agent can show them.

BehaviourDetail
Identifies itself asDuviBot
Obeys robots.txtAlways, checked before every page. A disallowed path is not read whatever it contains.
Finds pages viaThe sitemaps named in robots.txt. With none declared, it starts at the address you gave and follows links.
Stays withinThe address you gave. A bare domain covers the site; an address with a path stays under that path.

See Crawl a website for how to point the crawler at a site and narrow what it collects.