The drug and vaccine development process is a complicated and expensive affair that involves the dedication of more than a decade (an average of 12 years) to pre-clinical research and studies and then clinical trials. The results and objectives of these trials all need to be documented and submitted to the FDA to meet the compliance guidelines. Windward can automate this whole document generation process to meet all regulations set by the authorities (more about this below).
Here, we provide a guideline on the type of documents that should be prepared, when they need to be used, and to whom they must be submitted for compliance.
“Clinical studies carried out in the clinical life cycle of drugs and vaccines quire innumerable documents necessary for effective planning, assessment, and communications of their outcome and approval ... all of which need to paint a consistent picture.”
Documents play a central role in the compliance and life cycle of drug discovery, development, and distribution. They are key for designing, conducting as well as reporting trials carried out in animals and humans. Also, they are important for monitoring manufacturing quality, packaging, labeling, market performance, and safe usage of drugs. Also, ICH guidelines (more so ICH E6), gives a standardization of regulations within which the U.S., Japan, and the EU can mutually accept clinical data from regulators operating within their jurisdictions, outlining essential documents needed to advance in a clinical life cycle while adhering to regulatory requirements.
A majority of the necessary compliance and drug life cycle documents are rather straightforward forms that need to be filled with appropriate information. Some are more complicated, requiring input from multidisciplinary teams to compile the necessary information.
This is where Windward’s document automation can make a real difference.
It can connect with a wide range of datasources to populate the created templates. The good news is even new clinical investigators and drug developers in your company can collaborate and create the templates needed for generating documents at every stage to meet the compliance regulations set by the authorities. Even an individual employee in your pharma company can create the templates and tags needed for generating hundreds of documents by using the Windward add-in for Microsoft Office.
Before testing new therapy techniques or drugs/vaccines on humans, developers need to apply for approval through the submission of Investigational New Drug (IND) if in the United States or Investigational Medical Product Dossier (IMPD) if in a member state of the EU. To facilitate initial human trials, the submissions give an overview of manufacturing information, up-to-date data on animal studies inclusive of toxicity data, clinical study protocols (CSPs) that are meant to govern the actual studies as well as information on the actual investigators that shall be running the studies. Updates to the submissions must be carried out in tandem with the developments in the process. They must include any new data generated from human and animal studies.
According to the ICH E6, several key documents need to be generated to hold clinical trials. Key among them are informed consent forms (ICFs), Investigator Brochures (IBs), and CSPs. These are important as they:
1. Outline available scientific information on the product (IB)
2. Explain the train-of-thought behind each study (CSP)
3. Explain in detail the purpose of the study devoid of scientific jargon participants of the trial (ICF)
4. Give the investigational plan in detail while describing the analyses necessary for achieving the study objectives (CSP)
The necessary documents are usually an intricate compilation of information (data) building on one another to paint a clear picture of the aim of the trials and how investigators hope to achieve them. It is important to employ document automation software to coordinate the collation of input from various stakeholders and create flawless documents that are consistent with the aims and objectives of the proposed studies.
Whether it is the protocol or information amendment documents, safety reports or annual reports they can all be created in quick time without any errors by running Windward in your applications. You can thus meet all regulatory requirements and obligations and proceed with the clinical research study without any further delay by filing and maintaining IND documents quite effectively using Windward.
Congratulations! you have initiated the clinical trials. However, you still have a lot more document generation ahead of you.
Thousands of documents are either updated or created in the clinical program life cycle, most of which are done while conducting clinical trials. Amendments to the CSPs are often made describing changes to planned studies or analysis. Often, this may be a result of impracticalities in original study designs necessitating the adaptation of activities into the feasible study design. Amendments might also be made due to the need to recruit more patients.
The Development Safety Update Report (DSUR) is an important document as it allows for the continuous collection and compilation of cumulative pharmacovigilance data collected while conducting clinical development programs. IBs need to be updated in readiness for the next stages of the study. Statistical analysis of trial data should be defined before viewing the data. These are outlined in the Statistical Analysis Plans (SAPs). Clinical teams need to have all the relevant documents in hand in advance. It can be rather frustrating to realize that a crucial document is missing just as you’re about to submit a new study. Creating a proper mind map for all necessary documents for clinical studies allows for quicker document generation, thus avoiding unnecessary delays in the study.
What’s not documented is considered undone in this phase!
This is why you need to generate documents about every aspect of your clinical trials. And, Windward can help you come up with complete, consistent, credible, and well-corroborated clinical trial documents that are compliant with the regulations.
It’s important to note that the intricacy of the compliance documents increases with the progress made in the development program. The first phase of clinical trials involves a small number of human subjects. The aim here is to investigate drug safety as well as its pharmacokinetics. The second phase of the trials is meant to assess the drug’s initial efficacy on subjects suffering from target conditions. Dose finding trials are also conducted in this phase to determine optimal dosages in which the medicine can be administered. The third phase includes large scale trials aimed at undoubtedly demonstrating the product’s effectiveness when administered at the designed dosage. This phase is important as it helps to improve the researchers’ understanding of safety profiles.
CSPs from the first phase and reports of simple second phase studies are often easier to document and report as they don’t have many assessments, making them less complicated to draft. CSPs of complex second and third phase studies contain several objectives including efficacy, pharmacokinetics, quality of life, and safety. They, therefore, contain assessments of each of the objectives from treatment groups or dose regimes and may even include sub-studies. The development of these documents may require months of deliberation before they can be compiled. The process of creating these documents often consists of the creation of multiple drafts and reviews or revisions as different stakeholders give their input on various phases of the trial.
IBs required at advanced stages of the clinical life cycle are more complex and difficult to produce. The purpose of this document is to bring investigators tasked with various aspects of the study up to speed on PK, profiles, drug safety, and efficacy.
By the third phase, there exists a host of data that requires to be compressed and compiled into brochures that are as easy to read as they are informative to meet all regulatory guidelines. Demand on the entire development team shoots up with the rising intricacies of documents required in advanced developmental stages.
Windward matches this demand during all these different phases. It can help churn out hundreds of thousands of documents in just a few clicks while ensuring all the information presented in the IBs are error-free.
A detailed Clinical Study Report (CSR) is necessary at the end of every trial. It contains a comprehensive description of study results, whether negative or positive. This report typically contains every single piece of information in the course of the study as well as descriptions of the study methodology inclusive of any changes to initial plans as stipulated in the CSP. The complexity of a CSR is also dependent on the complexity of the phase within which the trial was carried out. This also dictates the time taken to create it and the required manpower both in skill and disciplinary diversity that needs to be engaged. The amount of data that needs interpretation and evaluation is often the cause of the slow-paced nature of the process. That being said, teams working on this document or report need to be allocated a sufficient amount of time to process large amounts of information. Windward can play a key role in this process as it makes the document generation process fairly simple and swift with its intuitive and user-friendly features and interface.
It is mandatory that summaries of clinical trial results emanating from studies carried out in the EU or the US be published in online databases within a year of the trial’s completion. This is in accordance with FDAAA 801 regulations in the US and EU guidelines for approval of clinical trials on drugs meant for human consumption. The EMA policy prohibits the publishing of reports about any test drug on public platforms that contain information that could lead to the identification of subjects within the study. Your investigators and researchers are therefore obligated to point out potential pitfalls that would arise from the inclusion of the wrong information in CSRs. Doing so helps to avoid time and cost-intensive processes that are associated with redaction as summaries are being created. Here, Windward’s document automation software comes handy. You can set up specific handling for warnings and errors (either in the full report or per-tag basis) to ensure you generate error-free documents for complete compliance.
Once clinical development processes are complete, an application seeking marketing authorization needs to be made. This is done through the submission of a dossier containing a compilation of data from the clinical development process. The dossier typically includes summary documents that are written in accordance with common technical document (CTD) guidelines. CTD dossiers house a clinical section that comprises a clinical overview (Module 2.5) and summaries of biopharmaceutics, clinical pharmacology, clinical safety, and clinical efficacy (Module 2.7)
This dossier forms the backbone of the challenge posed to small lab researchers and big pharma employees of synthesizing numerous ideas as well as data into cohesive descriptions of that which is known of the drug. For example, the preparation of Modules 2.7 and 2.5 can be a year-long process depending on the intricacies of the drug and its intended use. The documents should be generated in such a way that regulatory reviewers can easily understand the available data gathered during clinical programs, and their interpretation with regards to the pharmacokinetic profile, safety, efficacy as well as the drug’s relative risks and benefits.
Plans for monitoring and minimization of potential risks that are associated with using the medication referred to as Risk Evaluation and Mitigation Strategies (REMS) in the United States and Risk Management Plans (RMP) in the EU must be included in the application document. Submission of RMPs is mandatory while that of REMS is upon the FDA’s request. To compile this document, the team involved needs to go through documents from all stages of the development program, assess key risks, and consider appropriate precautions to ensure proper monitoring as well as mitigation of the identified risks. A layperson’s summary is required in the RMP. This guarantees patients’ understanding of the risks involved in the treatments prescribed to them.
Windward can connect with multiple data sources during this stage to create these documents to ensure compliance and quick approval for marketing. And, you can generate documents in multiple output formats (PPTX, PDF, DOCX, and more) based on your needs.
Publication of data gathered in clinical studies is done either as PDF documents, informative websites, patient information sheets among others. This is done to draw the attention of physicians, patients, health authorities, and practitioners to potential risks and benefits of the new drug. Stringent compliance rules are governing how marketing practices are conducted as well as the claims made in any of the publications about new drugs.
After introducing a drug to market, all reports of safety events must be recorded, compiled and assessed continuously. Doing so yields the Periodic Benefit-risk Evaluation Report (PBRER), formerly referred to as the Periodic Safety Update Report (PSUR). Guidelines for the compilation of this document are given by the ICH. PBRER is aimed at the harmonization of worldwide reporting procedures on the safety experiences of medicinal products after approval. The preparation of this document is often a race against time as annual submission deadlines are regulated.
PBRER can only be compiled after data summaries for a particular reporting period are obtained and final reports are produced. Standardization of data presentation and production can help to streamline documenting processes by enabling the focusing of efforts by various teams on the identification of safety signals rather than wasting time arguing over data presentation techniques. This standardization is made possible by the fact that formats for assessing data are often similar across the different phases of development. Windward can help come with these crucial reports and documents in the right formats regularly to ensure pharmacovigilance and compliance guidelines are met.
Clinical studies carried out in the clinical life cycle of drugs and vaccines require innumerable documents necessary for effective planning, assessment, and communication of their outcome and approval. A majority of the documents are an intricate collation of research and data. These also work alongside other documents, all of which need to paint a consistent picture.
To generate these documents fast and flawlessly, you can take advantage of Windward’s document automation software. It will ease the pressure on the entire research and development team in your pharma company or lab research firm and ensure that documents generated correspond with their purpose and meet the compliance guidelines set forth by the authorities. Documents will be error free and data-powered.
Try Windward today.
Document Automation (also known as document assembly) is the design of systems and workflows that assist in the creation of electronic documents. These include logic-based systems that use segments of preexisting text and/or data to assemble a new document.
Document Generation is the process of creating hundreds, thousands, or even millions of personalized and distinct documents for internal or external use from a single template. While Document Generation is a subset of automation, for some products (not all) you can’t get just the Document Generation component of a Document Automation solution.
Reporting Software is a subset of Document Generation. Reporting software can’t do documents. But Document Generation software easily creates reports.
Tags are elements placed in the automation documentation template (DOCX, PPTX, XLSX) that the docgen system acts on when generating a document. These tags can be data to insert, business logic rules to conditionally display or suppress content, and much more. Each vendor has their own term for “tags.”
Going forward, the word docgen will be used to stand for Document Generation system in this guide. When something is template based Document Automation system, the word docauto will be used.
Every modern docgen product uses Microsoft Office as the template designer. While you can find a few very old products that have their own designer, you want to limit your consideration to those built on Office as it is far superior.
Some document generation solutions work with Word, Excel, & PowerPoint while others are Word only. If you need Excel & PowerPoint, then obviously, go with a solution that supports them too. If you only need document automation tools using Word, think carefully if you might want Excel or PowerPoint someday in the future.
Again: if you go with a Word document automation solution, be very sure you won’t ever want Excel or PowerPoint. Ever!
The docgen solutions that have a separate addin or no add-in can usually work with any Word processor that can save as a DOCX file. It all tends to work exactly the same. For a full Word clone, this can work every bit as well.
Google Docs in this case though tends to be problematic because Google Docs does not have the layout and formatting capability of Microsoft Word. Not even close. Your limit here is not the docgen app; it’s Google Docs. For most use cases, Google Docs is not up to the job.
Some docgen solutions include an add-in to help you place & edit the tags in the template. These come in two flavors; one much better.
First, some automated document creation solutions have no add-in to assist in crafting tags. You usually end up with notepad open where you write all the various tags and you copy from there and paste into Word. And for special uses, you type in, from memory or other notes, the additional properties.
This “no add-in” approach is slow, painful, & error prone. If you have 5 templates, each with 5 tags – then no big deal. But if every month you’re creating 100 templates, each with 150 tags, you’re now in hell.
While Windward can legitimately claim to be a "no Add-In" solution for designing on platforms other than Windows - we find that approach so inferior, we state that we cannot be used for this use case.
We prefer to not get your business rather than provide you a significantly inferior approach.
Not only is it slow & expensive, but because it is a death march, designers will not put in the effort to make a business document template shine. They just want to be done.
The second approach (much better) is a second application (usually in a browser) that helps you write tags. You still have to copy & paste between this second app and Word, but the add-in provides all possible choices for tags and helps you write your queries.
Not all the side-by-side add-in approaches are the same. Play with each carefully to see how it works for you; not in simple sample cases, but in the more complex document templates you will need to create.
The third approach (best) is an add-in that becomes part of Word; adding additional tabs to the ribbon. This makes adding and revising tags a breeze because it works on the tag in the template. And while helping to write each tag, it can do so in the context of where it is in the template.
The incorporated add-in approach is by far the best in template based document generation. But by definition, it is limited to Office on Windows.
This add-in is one of the two features (the query wizard below is the other) that determines how much time your team will spend to design document templates, day after day, week after week, year after year. If one approach is 15 seconds longer, and you are going to create 500 templates each with just 35 tags (that’s low), that’s 73 hours.
While all the Document Generation solutions require you write code to call them (docauto is a no-code solution so not an issue), some of them require additional code for each template. This is called “code behind.”
In some cases, this code behind is defining different data specifications, such as you now also need the hire date. For these solutions, you don’t need code for each template, but a fair number of times templates will require additional data, or data ordered differently, and you have a code change.
Even worse, some require code behind for each template. Therefore, each new template based document generation means additional code. This is a giant hit.
Why? First you have programmers involved in template design. That’s expensive and slows the process down. Second, each new template requires rebuilding your application and pushing it through test & staging.
The one advantage to code behind is the developers can build data on the fly as it’s needed, including data generated according to business rules within the code. But in almost all cases, doing so directly in the template, as opposed to in the code behind, is superior.
In other words, you want the template file to be everything.
1. How do you create a doclet?
The best solution is to select content in Word and save that as a doclet. If it's more restrictive than this, will those restrictions stop you from creating very useful doclets?
2. Does it bring the full formatting of the doclet into the document it is dropped into?
This is actually a very hard thing to do in Word if the doclet uses styles that exist in the template with the same name - but different settings.
3. What can be saved?
Just template content? Or can you also save datasources, parameters, and more? This is not as important, but it is still a timesaver.
4. After you drop is it complete? Or do you need to perform additional steps? For example, if a doclet uses a different datasource, is that datasource now also tied to the template?
Not that important, but nice to have.
5. Can doclets in a template be updated?
If a doclet is the company logo and the logo changed, can all the templates using that doclet be updated to the new logo universally?
The dropped doclets come in several flavors. The optimum are linked doclets where the content of the doclet is displayed in your template in full, fully laid out and formatted. And as it is linked, when the doclet itself is revised, that change immediately appears in your template and is used in every generated document.
Once you drop a doclet into your template, you can can adjust it any way you wish from formatting to tags in the content. But if the original doclet is changed, that change is not applied in your template. In some uses this is preferable when you don’t want changes applied to existing templates.
The third approach is there is a tag that will import the doclet. You don’t see the contents of the doclet in your template, but when the template is processed, it will pull the live copy of the doclet. This is valuable when you have a select that will determine which doclet to import. This is useful for cases like you need to pull in content based on the State the recipient of the document lives in.
The optimum of course is to have all three flavors available to use each as appropriate.
Your most common activity creating templates will be writing the queries to select the data. You do this to select blocks of data such as all stocks you hold for a portfolio statement. You also do this for conditional logic in the template such as adding insurance requirements for an offer letter if they reside in California. Or when placing a name in loan papers.
Some docgen products do not have query wizards. With no wizards, then template creation is a developer-only task. And for developers, it will be slower. No wizards mean you can never turn template creation over to business users.
You will do this hundreds of times in complex templates. Thousands of times across all the templates. You want this to be quick & easy. This functionality, more than everything else put together, determines how much time you will spend designing templates, and how pleasant it is.
When you evaluate different document creation automation solutions, have a business user use the system to craft the queries and see how well they do. They’ll be slow & hesitant at first. But it’s key to see if they can learn it and then be successful on their own.
In the case of conditional tags (if, switch, etc.) make sure it also works well on elements returned by other tags (usually the iterative tags). Because in this case, it’s not a query of the data, it’s a condition on data already returned.
Finally, keep in mind that no matter how brilliant the query wizards are, the user will also generally struggle with the structure of the data (the metadata). This can be displayed to the user, but they still need to learn what is where. Reducing what metadata is displayed, providing the descriptions for each node in the metadata, etc., can make the difference between a usable and unusable solution for business users.
If you have a single datasource, then skip this section – you don’t care.
Ok, you have multiple datasources, for example Salesforce & Marketo. And you have documents you want to populate with data from each. In this case you must get a docgen solution that lets you have tags in a single template that are marked for which datasource that tag is to be applied to.
Some automate document generation providers implement this in two passes: First applying all the Salesforce tags and then starting over and applying all the Marketo tags. This works fine if you are not intermixing the data.
Sometimes you need to intermix the data: for example, if your document lists all Account Executives (from Salesforce) and then within the data for an AE it lists the emails they were sent (from Marketo). Then you need a solution that processes all datasources simultaneously.
If you have multiple datasources, you almost certainly will eventually need the best automated document assembly software that processes multiple datasources simultaneously. If it’s not a must-have today, it probably will be a must-have in a year.
Some tags have a start and end location, such as the if and forEach (iterative) tags. Generally, these are used to repeat or conditionally include a row in a table or a paragraph of text. All solutions do this.
But as time goes on and you create more advanced & complex templates, you will find yourself wanting to start the iteration in the middle of a table or an if that removes two cells and adjusts the table correctly.
In addition, you almost certainly will need a forEach (iterative) tag that adds columns in a table, as opposed to rows. You may want a column for each product or each month in a dataset. Finally watch out for any limitations on combinations. At the start you need a single forEach tag. A year later you are nesting five forEach tags within each other as it’s the only way to get what you want.
This is an area where it’s impossible to give guidance on what you may someday need. Your best bet is to select a solution that has no limitations on the start & end location.
For a simple template, this doesn’t matter (much). But as the logic expands in a template, you find that you are adding a lot of control tags. The most common are the iterative (forEach) and conditional (if) tags. But even a moderately complex template will also have numerous query and set tags along with several additional tags.
These tags, if displayed, pollute the template and enlarge the layout in the template. Usually you’ll find the template looks quite different from the final generated report. This makes it difficult to truly imagine the final document from the template. It’s frustrating to have to constantly run test documents to see what you’re going to get.
You’ll be much happier if the designer can at the click of a button hide or show the control tags. Show them when you’re working on the template logic. Hide them when you’re working on the final layout and formatting. This option will save you time and more importantly will make the design experience more pleasant.
The best way to use content across multiple templates is to have that content in a child template that the parent templates all import. These imported templates can be brought in as an explicit filename or as a data query that returns the filename.
Trust me: unless your needs are incredibly simple, you need this. You can work around it even if you repeat the same content in 100 templates, but you’re giving yourself too much extra work when wording changes due to company directives or legislation.
One critical detail on imports: Does the system process tags in the imported child template? If all of your child templates are static text (legal clauses), then this does not matter. But if you need to include anything live (a person’s name, a date, a state of residence), then you need a solution that process tags in the imported child template.
Finally, for Word only, how does it handle style mismatches? If the parent has the Normal style set to Times New Roman 12pt and the child has Normal set to Verdana 10pt, then what should the child paragraphs be styled as? This can be a royal pain because different users never have their styles matching.
Some systems convert the child to the parent formatting. Some retain the child formatting. And some (best solution) give you the option of either. The option is best but if it’s forced one of the two ways, make sure the system you get works that way.
Not having the expected styling on output is guaranteed to get upper management upset.
For the solutions that allow queries in the tags, you want one that also supports complex functions operating on the data. And not just simple functions like SUM() and COUNT() but most of what’s available in Excel. You will use Text and DateTime a lot.
In addition, can you add your own functions? Adding custom functions is often a significant component of providing a simple & easy design experience to business users. It’s also a lot safer. For complex calculations you write it once in the function and test it carefully. No worries about someone screwing it up writing it by hand in a template.
All of the products (I believe) support reading files from BASIC, Digest, Negotiate, & Oauth2. But what about a special Authenticate & Authorize you created in your company for one set of files? Or something special to get to a JSON file from a REST service that is home grown?
First off, make sure the solution supports the standard protocols you use. You should get a yes. And if that’s all you have – fantastic; you can skip to the next section. If you have a home-grown A&A. find out what needs to be done to have the system access it. This is a custom Access Provider. And make sure that the same Access Provider is used for reading data files (XML & JSON), accessing OData, and importing files (templates & pictures).
If you want to create DOCX or XLSX files where an employee can then edit parts of it, this is incredibly valuable. For example, you are generating portfolio statements and the legal disclaimers and actual financial results must not be changed, but there is a paragraph where the financial advisor can write up more summarizing the performance.
In this case, some of the solutions will carry document locking in DOCX & XLSX (PPTX does not have this) over to the output. So, if the template has locked all except one paragraph, then the generated DOCX will be locked except for that one paragraph.
Having the document locking functionality tends to make your lawyers very very happy. It eliminates a source of serious legal liability.
What is provided here is all over the board. And it’s difficult to get specific about what is most useful to you, as opposed to the next person. The best advice here is just look at what they have and try it out when evaluating.
One tool is validating a template. Not running it, but inspecting it and providing information on errors found. A second tool is to generate the document and deliver a list of errors and warnings. For example, if some content is placed off the page, it was rendered but you don’t see it. In this case it’s useful to have a listing of content off the page.
In this category you can include tag settings - what to do if a select fails, returns nothing, etc. Some of these are particularly useful but in other cases, you can find yourself investing more time than it’s worth.
What if you are generating portfolio statements using a Word template? It has descriptive text, a chart showing performance, legal disclaimers, etc. But where it has a table showing the actual numbers, you want to place an embedded spreadsheet with the numbers.
Why? Because this way the recipient can open that spreadsheet and then, using Excel, measure that data any way they want. It’s a much-improved portfolio statement and something that makes the recipient go WOW.
If you want this, verify that the document automation vendors you select not only carries embedded objects to the output, but that the embedded object, if a DOCX/PPTX/XLSX file, has tags in it processed. To make good use of this functionality the embedded object must be treated as a live template, not a static document.
If fully implemented, the output to any format, such as PDF, will include the displayed embedded object.
This is a DOCX -> PDF issue. Do you need to have form fields in the DOCX such as drop down, list or check box become the equivalent thing in PDF output? If so, you need to verify that this feature is supported.
In addition, make sure that the initial content/value in the form field can be set from data. If it’s just static values from the template, that tends to not be sufficient for all use cases.
And a suggestion. When you need an empty or checked box depending on data, don’t use a form field. Use the Wingdings characters and .
This is two XLSX -> XLSX issues. First, verify that a formula like SUM(D5:D5) expands to SUM(D5:D15) for the case where the row 5, inside an iterative loop, becomes rows 5 to 15. It’s very useful to have the formula adjusted (some products just write the literal value) on the output. This way, when someone adjusts say D7 to see what happens, all the formulas now adjust to that difference.
The same for pivot tables. If a pivot table is for D1:H5 and the generated XLSX now has those rows as D1: H125, the pivot tables are adjusted to match. This is necessary to use the pivot tables in the generated XLSX.
If you’re going to generate XLSX for Excel Power Users, this is key.
This is not an issue for docauto, just document generation.
There are three ways to call a docgen engine: Direct calls to a library, calls to a RESTful server on premises, and calls to a hosted (SAAS) RESTful server. Ask if they have what you want.
One note on Hosted solutions: You will be sending data to that system. First, you want to make sure that the vendor is providing adequate security. Second, if your data is not allowed to go outside your country or region (E.U.), find out not just where the default server is, but also the failover server.
If you’re concerned enough about security to be asking these questions, you should probably host the RESTful server yourself. Even if you place it on AWS or Azure, you are controlling access to the server and its location.
If all your data is JSON (or any other type), you don’t have to worry about what else the system can access. With that said, everything is getting more interconnected and odds are sooner or sooner you will have to access other datasource types.
Life is a lot safer if the solutions can use data from SQL, XML, JSON, & OData. (And why OData? 150 other vendor’s datasources, from ACT to Salesforce to Zoho.) Not a deal breaker but it will turn out to be useful.
See if you can create datasets from datasources. This is akin to views in SQL but you are creating them in the template (no DBA needed). And you want them for XML, JSON, & OData too. A good guide to how robust the dataset implementation is–do they basically become another datasource? If so, that’s a full implementation.
Furthermore, it can take time and bandwidth to download the metadata from a datasource. We saw one DB2 database take 28 minutes to download the full metadata (yes – truly!). If you have datasources with large metadata structures, find out if they have a way to read the schema once and reuse that. (This is unlikely to ever be needed for XML or JSON–it’s SQL, OData, & any custom datasources.)
Finally, for XML, make sure it uses the XML schema if one is available.
Check that it renders in the output formats you need. Everyone does PDF, HTML, DOCX, XLSX, & PPTX (last two if they support that template type). Additional output formats might be useful, but odds are you’ll never need them.
Check the accuracy of the PDF output. Everyone is imperfect on this. And in their, and our, defense, Microsoft does not document how Word calculates page layout. It does not specify the calculation between 2 lines of single-spaced text. And it’s impossible to reverse engineer accurately–Word is clearly performing complex calculations, not just using the font metrics.
Everyone does their best. Some come closer than others. Look for a good match but accept it won’t be perfect.
All products have a way to pass parameters to the template to use in the queries. Check that they have all the data types you need (they probably do).
Check that parameters can be set in a select as both a parameter (avoid injection attacks) and as a string substitution if desired. Setting as a parameter is valuable not only to avoid an injection attack, but to handle the cause of passing the name O’Malley.
Does the designer have a way to show the structure of the tags in the document? And clicking on one, go to that tag? There is no need for this in simple templates. but when you get to 30+ tags it becomes useful. And at 80+ it becomes essential.
If you’ll always be under 50 tags, no big deal. But if you start under 50 tags and will grow to 200+ tags in a template, not having this will become a big deal. So think about where you’ll be in 5 years.
If you run a template and it takes forever, or it completes but it’s 2,00 pages long when you expected 2 pages – why? You can ask a DBA and they can track your selects and tell you the problem.
It’s faster & easier if the template add-in has a tool that tells you for each iterative select how many rows of data it returns and how long the query took to complete. From this you can quickly find what is wrong.
Useful, not essential.
This is used once and saves at most 15 minutes - but it is very nice to have. This is irrelevant for the solutions that have code behind – they create code for each template.
For the one-time code to illustrate what code is needed to add to your application to use the docgen system, it’s ideal if they include a generate code feature that provides you sample code.. And in addition, you know the correct way to call the engine.
Nice, not essential.
Fortunately, these are rarely needed. But when needed, they can be a big time saver. There are several different debuggers that may be in a docgen template designer add-in.
As stated above, these are rarely needed so they're in the "useful but not important" category - except that one time you really really need it.