|By Tom Leyden||
|October 25, 2013 10:30 AM EDT||
I’ve been blogging quite a bit at DDN these days, which doesn’t leave me with a lot of time to write here, so I thought I’d syndicate a few of my WOS articles here at Clouds & Beer:
When Albert Einstein attended the Hollywood premier of the movie, City Lights, the crowds cheered him on wildly. Charlie Chaplin told him, “They cheer me because they all understand me, and they cheer you because no one understands you.” When Einstein won the Noble Prize in Physics in 1921, it was for “his services to Theoretical Physics, and especially for his discovery of the law of the photoelectric effect.” Still, no one in the world truly understood his theory of relativity at the time. Object storage is not any different from any other smart historic paradigm shift – technology or otherwise. In essence, it’s a pretty simple storage theory, but people have yet to fully grasp the real value of object storage and time will tell whether they’re able to leverage the opportunities it enables.
While DDN probably won’t win the Noble prize for Physics anytime soon, we are getting recognition for how we’re changing the storage industry with Web Object Scaler (WOS). And these days, that recognition is coming directly from Albert Einstein, or at least the University he agreed to give his name to in 1953.
The Albert Einstein College of Medicine was founded as a department of Yeshiva University in 1951 to “prepare physicians and researchers to excel in the science and the art of medicine and basic, translational and clinical investigation.” Einstein was charmed by the fact that the school would “welcome students of all creeds and races.”
Fast forward to 2013: Shailesh Shenoy, the program’s director of engineering and operations at Albert Einstein College of Medicine, had a storage problem to solve: the Integrated Imaging Program’s (IIP) microscopes in his department were generating more data than his infrastructure could manage. We at DDN call that ‘a Big Data problem’. The IIP microscopes generate approximately 1 TB per week of specimen images. Like most research centers, the department has limited resources and IT staff. Therefore, it needed a storage system that would be easy to scale and manage, and provide integrated multi-site data protection and collaboration. More details about the use case can also be found in this article by TechTarget’s Carol Sliwa.
At DDN, we are always very excited to learn and write about customer projects. This project is still in its infancy, but there are a few very interesting elements in it with regards to object storage:
- The data in case is sensor data, more specifically state-of-the-art microscope data. Future upgrades of these “sensors” will provide even higher resolution images, which again will impact the department’s storage requirements. As a result, data volumes for this project will increase both in object quantities and object sizes.
- Shailesh Shenoy understood early on that he needed to deploy a storage infrastructure with no scalability limitations. While his current needs could still be managed by conventional storage, he recognized that only object storage would allow him to avoid future migration projects. Also, as the storage for the IIP is managed by the engineering and operations team, management-intensive storage architectures were not an option.
- The biggest value of WOS for the IIP, however, is the straightforward application integration through the native WOS API’s. Instead of mounting shared network drives, users can now collaborate using a simple Java client that connects to the open source OMERO microscope image management system. And this is only the start as Mr. Shenoy is planning to have more applications connect to WOS. One shared storage pool for multiple applications, it’s what object storage was designed for.
What I found particularly interesting in Carol Sliwa’s coverage of this DDN success story, is how it neutralizes the two key arguments against object storage: “Two knocks on object storage systems have been performance and proprietary APIs, but neither has been a problem for Shenoy. He said WOS performance has been good, and DDN’s proprietary WOSLib and HTTP/REST APIs don’t concern him. Some of IIP’s collaborators also use WOS.”
Such testimonials are very important in the object storage debate, and it’s great to see WOS solve the issues that other platforms have been creating. Once again, the NoFS, pure object storage design (WOS is the only object storage platform with no file systems anywhere in the architecture) is key to the success. In this case it helped to meet the performance requirements for Shenoy’s project. Even more important are DDN’s efforts to provide easy application integration: by offering a wide selection of API’s (Native REST, S3, application-specific API’s), file system gateways and by supporting third party applications like iRODS, the University was able to put WOS in production in the shortest time. We’re pretty sure that Albert Einstein would have been proud!
DDN probably won’t win the Nobel prize for Physics, but we did come close this year! A Belgian co-winner is good enough for me!
Almost two-thirds of companies either have or soon will have IoT as the backbone of their business in 2016. However, IoT is far more complex than most firms expected. How can you not get trapped in the pitfalls? In his session at @ThingsExpo, Tony Shan, a renowned visionary and thought leader, will introduce a holistic method of IoTification, which is the process of IoTifying the existing technology and business models to adopt and leverage IoT. He will drill down to the components in this fra...
Aug. 29, 2016 01:01 PM EDT Reads: 114
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
Aug. 29, 2016 12:45 PM EDT Reads: 2,008
There is growing need for data-driven applications and the need for digital platforms to build these apps. In his session at 19th Cloud Expo, Muddu Sudhakar, VP and GM of Security & IoT at Splunk, will cover different PaaS solutions and Big Data platforms that are available to build applications. In addition, AI and machine learning are creating new requirements that developers need in the building of next-gen apps. The next-generation digital platforms have some of the past platform needs a...
Aug. 29, 2016 12:15 PM EDT Reads: 798
19th Cloud Expo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterpri...
Aug. 29, 2016 12:00 PM EDT Reads: 3,180
SYS-CON Events announced today Telecom Reseller has been named “Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Aug. 29, 2016 08:00 AM EDT Reads: 933
Pulzze Systems was happy to participate in such a premier event and thankful to be receiving the winning investment and global network support from G-Startup Worldwide. It is an exciting time for Pulzze to showcase the effectiveness of innovative technologies and enable them to make the world smarter and better. The reputable contest is held to identify promising startups around the globe that are assured to change the world through their innovative products and disruptive technologies. There w...
Aug. 29, 2016 07:30 AM EDT Reads: 815
With so much going on in this space you could be forgiven for thinking you were always working with yesterday’s technologies. So much change, so quickly. What do you do if you have to build a solution from the ground up that is expected to live in the field for at least 5-10 years? This is the challenge we faced when we looked to refresh our existing 10-year-old custom hardware stack to measure the fullness of trash cans and compactors.
Aug. 29, 2016 02:15 AM EDT Reads: 1,834
The emerging Internet of Everything creates tremendous new opportunities for customer engagement and business model innovation. However, enterprises must overcome a number of critical challenges to bring these new solutions to market. In his session at @ThingsExpo, Michael Martin, CTO/CIO at nfrastructure, outlined these key challenges and recommended approaches for overcoming them to achieve speed and agility in the design, development and implementation of Internet of Everything solutions wi...
Aug. 29, 2016 01:45 AM EDT Reads: 2,199
Cloud computing is being adopted in one form or another by 94% of enterprises today. Tens of billions of new devices are being connected to The Internet of Things. And Big Data is driving this bus. An exponential increase is expected in the amount of information being processed, managed, analyzed, and acted upon by enterprise IT. This amazing is not part of some distant future - it is happening today. One report shows a 650% increase in enterprise data by 2020. Other estimates are even higher....
Aug. 29, 2016 01:15 AM EDT Reads: 3,027
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
Aug. 29, 2016 12:00 AM EDT Reads: 1,912
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
Aug. 28, 2016 10:30 PM EDT Reads: 4,072
Smart Cities are here to stay, but for their promise to be delivered, the data they produce must not be put in new siloes. In his session at @ThingsExpo, Mathias Herberts, Co-founder and CTO of Cityzen Data, will deep dive into best practices that will ensure a successful smart city journey.
Aug. 28, 2016 06:30 PM EDT Reads: 1,648
SYS-CON Events announced today that 910Telecom will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Housed in the classic Denver Gas & Electric Building, 910 15th St., 910Telecom is a carrier-neutral telecom hotel located in the heart of Denver. Adjacent to CenturyLink, AT&T, and Denver Main, 910Telecom offers connectivity to all major carriers, Internet service providers, Internet backbones and ...
Aug. 28, 2016 06:00 PM EDT Reads: 1,965
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devices - comp...
Aug. 28, 2016 01:45 PM EDT Reads: 3,712
DevOps at Cloud Expo, taking place Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long dev...
Aug. 28, 2016 01:00 PM EDT Reads: 2,469
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
Aug. 27, 2016 08:45 PM EDT Reads: 2,426
I wanted to gather all of my Internet of Things (IOT) blogs into a single blog (that I could later use with my University of San Francisco (USF) Big Data “MBA” course). However as I started to pull these blogs together, I realized that my IOT discussion lacked a vision; it lacked an end point towards which an organization could drive their IOT envisioning, proof of value, app dev, data engineering and data science efforts. And I think that the IOT end point is really quite simple…
Aug. 27, 2016 12:45 PM EDT Reads: 2,401
Personalization has long been the holy grail of marketing. Simply stated, communicate the most relevant offer to the right person and you will increase sales. To achieve this, you must understand the individual. Consequently, digital marketers developed many ways to gather and leverage customer information to deliver targeted experiences. In his session at @ThingsExpo, Lou Casal, Founder and Principal Consultant at Practicala, discussed how the Internet of Things (IoT) has accelerated our abil...
Aug. 27, 2016 02:30 AM EDT Reads: 2,081
Is the ongoing quest for agility in the data center forcing you to evaluate how to be a part of infrastructure automation efforts? As organizations evolve toward bimodal IT operations, they are embracing new service delivery models and leveraging virtualization to increase infrastructure agility. Therefore, the network must evolve in parallel to become equally agile. Read this essential piece of Gartner research for recommendations on achieving greater agility.
Aug. 25, 2016 05:15 PM EDT Reads: 919
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
Aug. 25, 2016 01:00 PM EDT Reads: 2,729