IBM Cloud Authors: Liz McMillan, Elizabeth White, Roger Strukhoff, Pat Romanski, Sematext Blog

Blog Feed Post

MarkLogic 6: An introduction


The latest permeation of MarkLogic (version 6) offers ACID (atomicity, consistency, isolation, durability) transactions, horizontal scaling, real-time indexing, high availability, disaster recovery, government-grade security and built-in search.

MarkLogic has made application development easier with Java and REST APIs. They also added JSON support. This allows developers to use their language of choice, and eliminate the need to learn new production language. It also provides data visualization widgets. These widgets can display the shape and dimensions of data, identify trends or patterns and explore the data as a whole.

Version 6 also comes with built in database analytics. Integration with IBM Cognos and Tableau is included as well. This enables analysts to create reports, dashboards and the data. Lastly, version 6 adds the in-database MapReduce capabilities.

Find out more about MarkLogic version 6 here.

And here is more from their website:

Mission-critical Big Data Applications around the world are powered by MarkLogic. It is the only Enterprise NoSQL database that manages all types of data at scale in real time. It gives you the range of features you need to deliver value. It lets you leverage your existing tools, knowledge, and experience. And it provides a reliable, scalable, and secure platform for your important data.

New Feature Highlights

Business Intelligence Tools

Business Intelligence Tools
Big Data in the enterprise needs to be accessible to everyone who could benefit from the information. To make that easier, MarkLogic now includes out-of-the-box integration with Business Intelligence tools like IBM Cognos and Tableau to allow analysts to use familiar solutions for generating reports, dashboards and data exploration results from data stored in MarkLogic.



In order to enable developers to work in their language of choice, MarkLogic now includes a REST API that allows you to perform searches, create documents, read documents, update documents, and delete documents. The REST API allows you to build fully functional MarkLogic applications in any programming language. It also allows you to directly load JSON documents.


MarkLogic Java API

MarkLogic Java API
The new Java API allows you full-featured access to MarkLogic functionality with pure Java. The MarkLogic Java API is written on top of the REST API, and has all of its functionality such as paginated search with facets and snippets, full document CRUD operations, and more.


Enhanced JSON Support

Enhanced JSON Support
Our new JSON library makes it easy to store JSON documents as key-value stores, and to convert them back and forth between JSON and XML. The REST Client API and the MarkLogic Client API for Java make use of this functionality to make it easier to load and work with JSON documents.


Visualization Widgets

Visualization Widgets
We’ve also added Visualization Widgets so you can easily build powerful applications that help your users discover the shape and dimensions of data, quickly assess trends and patterns, and explore data more intuitively. You can access these widgets with MarkLogic Application Builder.


In-database MapReduce & User Defined Functions

In-database MapReduce & User Defined Functions
Many customers wanted more flexibility to develop complex, real-time analytics. We’ve extended MarkLogic 6 to let you create user-defined aggregate functions (UDFs) that take advantage of MarkLogic’s parallel-processing architecture. We call this In-database MapReduce, and it lets you create blindingly fast analytic functions with custom C++ code by writing “map” and “reduce” functions.


In-Database Analytic Functions

In-Database Analytic Functions
In order to enable customers to leverage the power of the MarkLogic platform to produce enterprise-grade analytics, we’ve included several built-in XQuery functions to perform analytic and statistical functions.


MarkLogic Content Pump (mlcp)

MarkLogic Content Pump
In order to speed loading and exporting of data between databases, we are introducing the MarkLogic Content Pump (mlcp). mlcp is a command-line tool for loading content into MarkLogic Server and for migrating content from one instance of MarkLogic to another, even if they are on different platforms. If you have a Hadoop cluster, mlcp takes advantage of Hadoop to parallelize the loading. mlcp takes much of the functionality of the open source projects Record Loader and xqsync and bundles them in a single package, and allows them to take advantage of Hadoop if it is available; Hadoop is not required to use mlcp, but is used if it is available.


FIPS 140-2 Cryptographic Compliance

FIPS 140-2 Cryptographic Compliance
MarkLogic 6 includes the OpenSSL Federal Information Processing Standard (FIPS) Object Module, which was evaluated by the National Institute of Standards (NIST) for FIPS 140-2 compliance. More details on the OpenSSL Object Module and on the FIPS 140-2 compliance.


Search API Enhancements

Search API Enhancements
When you’ve got a lot of data, great search is key. We’ve worked to make our search API even better with the following enhancements:

  • Structured Search
  • Extracting metadata at search time
  • Modify the unconstrained term behavior using <search:term>
  • Range constraints for path range indexes
  • Ability to return values from range indexes with search:values
  • JSON key support


Path Range Indexes

Path Range Indexes
In order to enable fine-grained range indexes while maintaining the advantages of using the lexicon functions and the range query constructors MarkLogic now includes support for range index specified by a path. You can specify a subset of XPath as the definition of what goes into an index. The search API can take advantage of path range indexes to create range constraints on them. Path range indexes are also useful when setting up SQL views on data stored in a MarkLogic database.


Synonym Search

Synonym Search
You now have the option to ensure that documents that contain multiple synonyms are scored appropriately, rather than unnaturally gaining points to the search score. Learn more about how the architecture of MarkLogic works and how you can deploy it.

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder and partner at Cognitio Corp and publsher of CTOvision.com

@ThingsExpo Stories
Fact is, enterprises have significant legacy voice infrastructure that’s costly to replace with pure IP solutions. How can we bring this analog infrastructure into our shiny new cloud applications? There are proven methods to bind both legacy voice applications and traditional PSTN audio into cloud-based applications and services at a carrier scale. Some of the most successful implementations leverage WebRTC, WebSockets, SIP and other open source technologies. In his session at @ThingsExpo, Da...
In past @ThingsExpo presentations, Joseph di Paolantonio has explored how various Internet of Things (IoT) and data management and analytics (DMA) solution spaces will come together as sensor analytics ecosystems. This year, in his session at @ThingsExpo, Joseph di Paolantonio from DataArchon, will be adding the numerous Transportation areas, from autonomous vehicles to “Uber for containers.” While IoT data in any one area of Transportation will have a huge impact in that area, combining sensor...
The Internet of Things (IoT), in all its myriad manifestations, has great potential. Much of that potential comes from the evolving data management and analytic (DMA) technologies and processes that allow us to gain insight from all of the IoT data that can be generated and gathered. This potential may never be met as those data sets are tied to specific industry verticals and single markets, with no clear way to use IoT data and sensor analytics to fulfill the hype being given the IoT today.
@ThingsExpo has been named the Top 5 Most Influential M2M Brand by Onalytica in the ‘Machine to Machine: Top 100 Influencers and Brands.' Onalytica analyzed the online debate on M2M by looking at over 85,000 tweets to provide the most influential individuals and brands that drive the discussion. According to Onalytica the "analysis showed a very engaged community with a lot of interactive tweets. The M2M discussion seems to be more fragmented and driven by some of the major brands present in the...
If you had a chance to enter on the ground level of the largest e-commerce market in the world – would you? China is the world’s most populated country with the second largest economy and the world’s fastest growing market. It is estimated that by 2018 the Chinese market will be reaching over $30 billion in gaming revenue alone. Admittedly for a foreign company, doing business in China can be challenging. Often changing laws, administrative regulations and the often inscrutable Chinese Interne...
SYS-CON Events announced today that SoftNet Solutions will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. SoftNet Solutions specializes in Enterprise Solutions for Hadoop and Big Data. It offers customers the most open, robust, and value-conscious portfolio of solutions, services, and tools for the shortest route to success with Big Data. The unique differentiator is the ability to architect and ...
SYS-CON Events announced today that Pulzze Systems will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Pulzze Systems, Inc. provides infrastructure products for the Internet of Things to enable any connected device and system to carry out matched operations without programming. For more information, visit http://www.pulzzesystems.com.
In the next forty months – just over three years – businesses will undergo extraordinary changes. The exponential growth of digitization and machine learning will see a step function change in how businesses create value, satisfy customers, and outperform their competition. In the next forty months companies will take the actions that will see them get to the next level of the game called Capitalism. Or they won’t – game over. The winners of today and tomorrow think differently, follow different...
One of biggest questions about Big Data is “How do we harness all that information for business use quickly and effectively?” Geographic Information Systems (GIS) or spatial technology is about more than making maps, but adding critical context and meaning to data of all types, coming from all different channels – even sensors. In his session at @ThingsExpo, William (Bill) Meehan, director of utility solutions for Esri, will take a closer look at the current state of spatial technology and ar...
The Open Connectivity Foundation (OCF), sponsor of the IoTivity open source project, and AllSeen Alliance, which provides the AllJoyn® open source IoT framework, today announced that the two organizations’ boards have approved a merger under the OCF name and bylaws. This merger will advance interoperability between connected devices from both groups, enabling the full operating potential of IoT and representing a significant step towards a connected ecosystem.
SYS-CON Media announced today that @WebRTCSummit Blog, the largest WebRTC resource in the world, has been launched. @WebRTCSummit Blog offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. @WebRTCSummit Blog can be bookmarked ▸ Here @WebRTCSummit conference site can be bookmarked ▸ Here
SYS-CON Events announced today that Streamlyzer will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Streamlyzer is a powerful analytics for video streaming service that enables video streaming providers to monitor and analyze QoE (Quality-of-Experience) from end-user devices in real time.
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
@ThingsExpo has been named the Top 5 Most Influential Internet of Things Brand by Onalytica in the ‘The Internet of Things Landscape 2015: Top 100 Individuals and Brands.' Onalytica analyzed Twitter conversations around the #IoT debate to uncover the most influential brands and individuals driving the conversation. Onalytica captured data from 56,224 users. The PageRank based methodology they use to extract influencers on a particular topic (tweets mentioning #InternetofThings or #IoT in this ...
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in Embedded and IoT solutions, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 7-9, 2017, at the Javits Center in New York City, NY. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions® for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, HPC and ...
Cloud based infrastructure deployment is becoming more and more appealing to customers, from Fortune 500 companies to SMEs due to its pay-as-you-go model. Enterprise storage vendors are able to reach out to these customers by integrating in cloud based deployments; this needs adaptability and interoperability of the products confirming to cloud standards such as OpenStack, CloudStack, or Azure. As compared to off the shelf commodity storage, enterprise storages by its reliability, high-availabil...
Explosive growth in connected devices. Enormous amounts of data for collection and analysis. Critical use of data for split-second decision making and actionable information. All three are factors in making the Internet of Things a reality. Yet, any one factor would have an IT organization pondering its infrastructure strategy. How should your organization enhance its IT framework to enable an Internet of Things implementation? In his session at @ThingsExpo, James Kirkland, Red Hat's Chief Arch...
The IoT industry is now at a crossroads, between the fast-paced innovation of technologies and the pending mass adoption by global enterprises. The complexity of combining rapidly evolving technologies and the need to establish practices for market acceleration pose a strong challenge to global enterprises as well as IoT vendors. In his session at @ThingsExpo, Clark Smith, senior product manager for Numerex, will discuss how Numerex, as an experienced, established IoT provider, has embraced a ...
SYS-CON Events announced today that Cloudbric, a leading website security provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Cloudbric is an elite full service website protection solution specifically designed for IT novices, entrepreneurs, and small and medium businesses. First launched in 2015, Cloudbric is based on the enterprise level Web Application Firewall by Penta Security Sys...
We are reaching the end of the beginning with WebRTC, and real systems using this technology have begun to appear. One challenge that faces every WebRTC deployment (in some form or another) is identity management. For example, if you have an existing service – possibly built on a variety of different PaaS/SaaS offerings – and you want to add real-time communications you are faced with a challenge relating to user management, authentication, authorization, and validation. Service providers will w...