Wednesday, August 10, 2022
SCIENMAG: Latest Science and Health News
No Result
View All Result
  • Login
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US
No Result
View All Result
Scienmag - Latest science news from science magazine
No Result
View All Result
Home SCIENCE NEWS Technology and Engineering

Research by CMU, Twitter could improve cache efficiency by 60%

May 11, 2021
in Technology and Engineering
0
Share on FacebookShare on Twitter

Team wins top paper award at USENIX NSDI Conference

Research from Carnegie Mellon University may soon help Twitter run faster and more efficiently.

Juncheng Yang, a Ph.D. candidate in computer science, and Rashmi Vinayak, an assistant professor in the Computer Science Department, worked with Yao Yue from Twitter to develop Segcache to make better use of DRAM cache.

“We performed a large-scale study on how items were stored and accessed in the cache, and based on our research, we developed a system to make better use of the precious cache space,” Yang said. “This could potentially allow Twitter to reduce the largest cache cluster size by 60%.”

The team’s research won the Community Award for being one of the best papers at last month’s USENIX Symposium on Networked Systems Design and Implementation.

Most computers, from personal laptops to servers housing millions of tweets, store items in one of two systems: hard drives or dynamic random-access memory (DRAM). Hard drives store items permanently, while DRAM houses on-demand items, like files stored in the cache. Items in the DRAM can be retrieved quickly, but DRAM is relatively small, expensive and energy-consuming. How to better use that limited space has always been a hard problem to solve.

When you open Twitter, the tweets displayed immediately in the feed come from the cache. Without it, loading the homepage requires retrieving tweets from everyone you follow from the hard drive — which takes a long time and consumes system resources.

Segcache applies two techniques to better use cache space. First, it groups items to allow metadata sharing between them. Items in the cache are usually small — the most common length of a tweet is 33 characters. However, existing systems store large amounts of metadata with each item, wasting precious cache space. Grouping similar items and sharing their metadata reduces this overhead and uses the cache more efficiently.

The second technique is redesigning the system to identify and remove expired items more effectively. Cached items typically have a short lifetime, and when expired items linger in the cache they waste valuable space. The new design removes these items more quickly and with fewer scans than existing approaches, which need to scan all items periodically.

Yang and Vinayak said the collaboration with Twitter was crucial to their work, as the company allowed them to study the social media network’s production system. Twitter is now working to incorporate the team’s research into its production system.

“We and our collaborators at Twitter are very excited about this work,” Vinayak said. “Changing a production system is cumbersome, and companies rarely do it to incorporate the latest research. When the research that we do is used in the real world, it is very exciting.”

###

Media Contact
Aaron Aupperlee
[email protected]
https://www.scs.cmu.edu/news/research-cmu-twitter-could-improve-cache-efficiency

Tags: Computer ScienceInternetMultimedia/Networking/Interface DesignSoftware EngineeringTechnology/Engineering/Computer Science
Share25Tweet16Share4ShareSendShare
  • A role for cell ‘antennae’ in managing dopamine signals in the brain

    99 shares
    Share 40 Tweet 25
  • Order up: new study reveals importance of liquid structural ordering in crystallization

    79 shares
    Share 32 Tweet 20
  • Study finds second primary lung cancer is 4 percent and as high as 8 percent among surgery patients

    78 shares
    Share 31 Tweet 20
  • United Kingdom-based smoking cessation program reports that 30 percent of support in a lung cancer screening program: the Yorkshire Enhanced Stop Smoking Study (YESS)

    77 shares
    Share 31 Tweet 19
  • NELSON trial protocol more sensitive than NLST and may increase the benefits of lung cancer screening, while reducing unnecessary follow-up procedures

    77 shares
    Share 31 Tweet 19
  • Sub-lobar surgery for peripheral non-small cell lung cancer non-inferior to lobectomy

    76 shares
    Share 30 Tweet 19
ADVERTISEMENT

About us

We bring you the latest science news from best research centers and universities around the world. Check our website.

Latest NEWS

A role for cell ‘antennae’ in managing dopamine signals in the brain

Experts optimistic about converting coal plants to production of clean geothermal energy

The walk of Japanese children develops differently from children in other countries

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 193 other subscribers

© 2022 Scienmag- Science Magazine: Latest Science News.

No Result
View All Result
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US

© 2022 Scienmag- Science Magazine: Latest Science News.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In