Welcome!

Cloud Security Authors: Nishanth Kadiyala, Kevin Jackson, Elizabeth White, Stackify Blog, Peter Davidson

Related Topics: @BigDataExpo, Microservices Expo, Containers Expo Blog, @CloudExpo, Cloud Security, SDN Journal

@BigDataExpo: Blog Feed Post

WOS and E=MC2

The biggest value of WOS for the IIP, however, is the straightforward application integration through the native WOS APIs

I’ve been blogging quite a bit at DDN these days, which doesn’t leave me with a lot of time to write here, so I thought I’d syndicate a few of my WOS articles here at Clouds & Beer:

When Albert Einstein attended the Hollywood premier of the movie, City Lights, the crowds cheered him on wildly. Charlie Chaplin told him, “They cheer me because they all understand me, and they cheer you because no one understands you.” When Einstein won the Noble Prize in Physics in 1921, it was for “his services to Theoretical Physics, and especially for his discovery of the law of the photoelectric effect.” Still, no one in the world truly understood his theory of relativity at the time. Object storage is not any different from any other smart historic paradigm shift – technology or otherwise. In essence, it’s a pretty simple storage theory, but people have yet to fully grasp the real value of object storage and time will tell whether they’re able to leverage the opportunities it enables.

While DDN probably won’t win the Noble prize for Physics anytime soon, we are getting recognition for how we’re changing the storage industry with Web Object Scaler (WOS). And these days, that recognition is coming directly from Albert Einstein, or at least the University he agreed to give his name to in 1953.

The Albert Einstein College of Medicine was founded as a department of Yeshiva University in 1951 to “prepare physicians and researchers to excel in the science and the art of medicine and basic, translational and clinical investigation.” Einstein was charmed by the fact that the school would “welcome students of all creeds and races.”

Fast forward to 2013: Shailesh Shenoy, the program’s director of engineering and operations at Albert Einstein College of Medicine, had a storage problem to solve: the Integrated Imaging Program’s (IIP) microscopes in his department were generating more data than his infrastructure could manage. We at DDN call that ‘a Big Data problem’. The IIP microscopes generate approximately 1 TB per week of specimen images. Like most research centers, the department has limited resources and IT staff. Therefore, it needed a storage system that would be easy to scale and manage, and provide integrated multi-site data protection and collaboration. More details about the use case can also be found in this article by TechTarget’s Carol Sliwa.

At DDN, we are always very excited to learn and write about customer projects. This project is still in its infancy, but there are a few very interesting elements in it with regards to object storage:

  • The data in case is sensor data, more specifically state-of-the-art microscope data. Future upgrades of these “sensors” will provide even higher resolution images, which again will impact the department’s storage requirements. As a result, data volumes for this project will increase both in object quantities and object sizes.
  • Shailesh Shenoy understood early on that he needed to deploy a storage infrastructure with no scalability limitations. While his current needs could still be managed by conventional storage, he recognized that only object storage would allow him to avoid future migration projects. Also, as the storage for the IIP is managed by the engineering and operations team, management-intensive storage architectures were not an option.
  • The biggest value of WOS for the IIP, however, is the straightforward application integration through the native WOS API’s. Instead of mounting shared network drives, users can now collaborate using a simple Java client that connects to the open source OMERO microscope image management system. And this is only the start as Mr. Shenoy is planning to have more applications connect to WOS. One shared storage pool for multiple applications, it’s what object storage was designed for.

What I found particularly interesting in Carol Sliwa’s coverage of this DDN success story, is how it neutralizes the two key arguments against object storage: “Two knocks on object storage systems have been performance and proprietary APIs, but neither has been a problem for Shenoy. He said WOS performance has been good, and DDN’s proprietary WOSLib and HTTP/REST APIs don’t concern him. Some of IIP’s collaborators also use WOS.”

Such testimonials are very important in the object storage debate, and it’s great to see WOS solve the issues that other platforms have been creating. Once again, the NoFS, pure object storage design (WOS is the only object storage platform with no file systems anywhere in the architecture) is key to the success. In this case it helped to meet the performance requirements for Shenoy’s project. Even more important are DDN’s efforts to provide easy application integration: by offering a wide selection of API’s (Native REST, S3, application-specific API’s), file system gateways and by supporting third party applications like iRODS, the University was able to put WOS in production in the shortest time. We’re pretty sure that Albert Einstein would have been proud!

DDN probably won’t win the Nobel prize for Physics, but we did come close this year! A Belgian co-winner is good enough for me!


0

Read the original blog entry...

More Stories By Tom Leyden

Tom Leyden is VP Product Marketing at Scality. Scality was founded in 2009 by a team of entrepreneurs and technologists. The idea wasn’t storage, per se. When the Scality team talked to the initial base of potential customers, the customers wanted a system that could “route” data to and from individual users in the most scalable, efficient way possible. And so began a non-traditional approach to building a storage system that no one had imagined before. No one thought an object store could have enough performance for all the files and attachments of millions of users. No one thought a system could remain up and running through software upgrades, hardware failures, capacity expansions, and even multiple hardware generations coexisting. And no one believed you could do all this and scale to petabytes of content and billions of objects in pure software.

@ThingsExpo Stories
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...
When growing capacity and power in the data center, the architectural trade-offs between server scale-up vs. scale-out continue to be debated. Both approaches are valid: scale-out adds multiple, smaller servers running in a distributed computing model, while scale-up adds fewer, more powerful servers that are capable of running larger workloads. It’s worth noting that there are additional, unique advantages that scale-up architectures offer. One big advantage is large memory and compute capacity...
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Silicon India has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Published in Silicon Valley, Silicon India magazine is the premiere platform for CIOs to discuss their innovative enterprise solutions and allows IT vendors to learn about new solutions that can help grow their business.
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ara...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
The current age of digital transformation means that IT organizations must adapt their toolset to cover all digital experiences, beyond just the end users’. Today’s businesses can no longer focus solely on the digital interactions they manage with employees or customers; they must now contend with non-traditional factors. Whether it's the power of brand to make or break a company, the need to monitor across all locations 24/7, or the ability to proactively resolve issues, companies must adapt to...
"MobiDev is a Ukraine-based software development company. We do mobile development, and we're specialists in that. But we do full stack software development for entrepreneurs, for emerging companies, and for enterprise ventures," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that TMC has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo and Big Data at Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Global buyers rely on TMC’s content-driven marketplaces to make purchase decisions and navigate markets. Learn how we can help you reach your marketing goals.
SYS-CON Events announced today that TechTarget has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TechTarget storage websites are the best online information resource for news, tips and expert advice for the storage, backup and disaster recovery markets.
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Artificial intelligence, machine learning, neural networks. We’re in the midst of a wave of excitement around AI such as hasn’t been seen for a few decades. But those previous periods of inflated expectations led to troughs of disappointment. Will this time be different? Most likely. Applications of AI such as predictive analytics are already decreasing costs and improving reliability of industrial machinery. Furthermore, the funding and research going into AI now comes from a wide range of com...
SYS-CON Events announced today that Ayehu will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara California. Ayehu provides IT Process Automation & Orchestration solutions for IT and Security professionals to identify and resolve critical incidents and enable rapid containment, eradication, and recovery from cyber security breaches. Ayehu provides customers greater control over IT infras...
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business...
SYS-CON Events announced today that Conference Guru has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. A valuable conference experience generates new contacts, sales leads, potential strategic partners and potential investors; helps gather competitive intelligence and even provides inspiration for new products and services. Conference Guru works with conference organi...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
In this presentation, Striim CTO and founder Steve Wilkes will discuss practical strategies for counteracting fraud and cyberattacks by leveraging real-time streaming analytics. In his session at @ThingsExpo, Steve Wilkes, Founder and Chief Technology Officer at Striim, will provide a detailed look into leveraging streaming data management to correlate events in real time, and identify potential breaches across IoT and non-IoT systems throughout the enterprise. Strategies for processing massive ...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud com...