Oshyn Home Page
  • expertise
    • Overview
    • Contact Us |
    • Latest work: www.miramax.com
  • solutions
    • Overview
    • Content Management
      • Choosing a CMS
      • Sitecore Consulting
      • EPiServer CMS Consulting
      • Jahia Integration
      • Open Text Web Solutions RedDot CMS
      • Drupal Development
      • Common Issues
      • Training
    • Web Strategy
    • Mobile Platforms
    • Social Media
    • E-commerce
    • Portals & Collaboration
    • SOA
    • Contact Us |
    • Latest work: www.miramax.com
  • work
    • Overview
    • Client Quotes
    • Contact Us |
    • Latest work: www.websense.com
  • resources
    • Overview
    • News & Events
    • Newsletters
    • Blog
    • White Papers
    • Success Stories
    • Press Kit
    • Contact Us |
    • Latest work: www.disneydvd.com
  • partners
    • Overview
    • Agency Partner Program
    • Technology Partners
    • Contact Us |
    • Latest work: www.nea.org
  • company
    • Overview
    • Contact
    • Careers
    • Leadership Team
    • News & Events
    • Social Responsibility
    • Contact Us |
    • Latest work: www.icon4x4.com
Using WinSCP for SFTP connections from NAnt for Sitecore and EPiServer projects
  • Tweet
Friday, February 17, 2012  /   Christian Burne Christian Burne
close

Christian Burne


Although earlier in life, Christian thought he'd be a fireman, it turned out that he was really good with computers and especially good at explaining difficult technical solutions to non-technical people. His experience is primarily in Web Content Management, Java and .NET development and he's worked for clients in Biotech, Consumer Goods and Higher Education. Most days, you'll find him working on WCM / CMS projects trying to build the best software possible for Oshyn's customers. All outside work time is spent attempting to keep up with his 3 year old daughter, Clara.

Using WinSCP for SFTP connections from NAnt for Sitecore and EPiServer projects

Oshyn uses a combination of Jenkins and NAnt to do builds and deployments of our .NET projects (Sitecore and EPiServer). While this has worked great for us, one of the challenges has been the FTP deployments.  We had been using the FTPTask from Spin The Moose which was previously found here:  http://www.spinthemoose.com/~ftptask/.  

The NAnt tasks looked like this:

<loadtasks assembly="${path::combine(nant-ftptask.dir, 'bin/Release/ftptask.dll')}" />
    <connection id="ftp-conn" server="${server.ftp}" username="${user.ftp}" password="${password.ftp}" />
    <connection id="ftp-conn-cd" server="${cd.server.ftp}" username="${cd.user.ftp}" password="${cd.password.ftp}" />
    <ftp connection="ftp-conn" remotedir="${remotedir.ftp}">
      <put type="ascii" localdir="${website-source.ftp}" remotedir="">
        <include name="Web.config" />
        <include name="Global.asax" />
        <include name="ClientEventTracker.ashx" />
        <include name="ClientEventTracker.js" />
        <include name="LuceneSearch.css" />
      </put>
      <!-- Include in the following PUT all DLLs that are not part of the standard Sitecore installation -->
      <put type="bin" localdir="${website-source.ftp}/bin" remotedir="bin" createdirs="true">
        <include name="*.dll" />
        <include name="*.xml" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/layouts" remotedir="layouts" createdirs="true">
        <include name="**.ascx" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/xsl" remotedir="xsl" createdirs="true">
        <include name="**" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/js" remotedir="js" createdirs="true">
        <include name="**" />
      </put>
      <put type="bin" localdir="${website-source.ftp}/img" remotedir="img" createdirs="true">
        <include name="**" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/SearchUtils" remotedir="SearchUtils" createdirs="true">
        <include name="*.aspx" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/WebServices" remotedir="WebServices" createdirs="true">
        <include name="*.aspx" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/css" remotedir="css" createdirs="true">
        <include name="**" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/App_Config/Include" remotedir="App_Config/Include" createdirs="true">
        <include name="Sitecore.Analytics.ExcludeRobots.config" />
        <include name="Sitecore.Analytics.config" />
        <include name="ldap.config" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/App_Config/Security" remotedir="App_Config/Security" createdirs="true">
        <include name="*" />
      </put>
      <put type="ascii" localdir="${website-source.ftp}/App_Config" remotedir="App_Config" createdirs="true">
        <include name="*.config" />
      </put>
      <put type="ascii" localdir="${env-config-source.ftp}" remotedir="App_Config/Include" createdirs="true">
        <include name="Sitecore.Analytics.config" />
        <include name="ScalabilitySettings.config" />
        <include name="Forms.config" />
      </put>
      <put type="ascii" localdir="${env-config-source.ftp}" remotedir="App_Config"  createdirs="true" unless="${string::contains(environment.param, 'Prod')}">
        <include name="*.config" />
      </put>
      <put type="ascii" localdir="${env-config-source.ftp}/CM" remotedir="App_Config"  createdirs="true" if="${string::contains(environment.param, 'Prod')}">
        <include name="*.config" />
      </put>
    </ftp>
    <!-- The following FTP transfer is used only for Content Delivery server -->
    <ftp connection="ftp-conn-cd" if="${string::contains(environment.param, 'Prod')}">
      <put type="ascii" localdir="${env-config-source.ftp}/CD" remotedir="/Include">
        <include name="SwitchMasterToWeb.config" />
      </put>
      <put type="ascii" localdir="${env-config-source.ftp}/CD" remotedir="/">
        <include name="ConnectionStrings.config" />
      </put>
    </ftp>

However, as you can see if you followed the link, Dave Alpert has apparently stopped supporting the task.

We've been using this task for FTP protocol, but it does not support SFTP.  We quickly found there was no NAnt task alternative that did SFTP (at least not in a few hours of googling) so we decided to shell out using the <exec/> command.  The options for this were psftp.exe and WinSCP.  PSFTP appeared to be the easier and smaller footprint option so we tried that first.  The issue we encountered was how to get the program to not prompt the user to accept the key.  If Jenkins is running as SYSTEM service, it is not possible to get it to accept the key automatically.  After various attempts with wrapper shell files to redirect "Y" to stdin and registry settings, PSFTP was eventually abandoned.

WinSCP, it turns out, has a way to send in the key fingerprint via the command line.  This proved to work successfully and in fact, makes our NAnt a lot cleaner.  There are two steps involved:

  1. Creating the FTP Command file
  2. Executing the FTP Command file

Creating the FTP Command File

The FTP Command file contains as the first line the connection string including the -hostkey parameter as follows:
    <property name="connectionString.ftp" value="open sftp://${user.ftp}:${password.ftp}@${server.ftp} -hostkey=&quot;${rsakey.ftp}&quot;"/>
    <echo file="${ftp.command.file}">
      ${connectionString.ftp}
      option echo off
      option batch on
      option confirm off
      option exclude "*/.svn; *.cs; *.example; *.pdb;"
    </echo>
    <echo file="${ftp.command.file}" append="true">
      cd ${remotedir.ftp}
      ascii
      put "${website-source.ftp}\*.config"
      put "${website-source.ftp}\*.as*x"
      put "${website-source.ftp}\*.css"
      put "${website-source.ftp}\*.js"
      put "${website-source.ftp}\layouts"
      put "${website-source.ftp}\xsl"
      put "${website-source.ftp}\js"
      put "${website-source.ftp}\ErrorPages"
      put "${website-source.ftp}\SearchUtils"
      put "${website-source.ftp}\WebServices"
      put "${website-source.ftp}\css"
      put "${website-source.ftp}\App_Config"
      bin
      put "${website-source.ftp}\bin"
      put "${website-source.ftp}\img"
    </echo>
    <echo file="${ftp.command.file}" append="true">
      ascii
      cd /${remotedir.ftp}/App_Config
      put "${env-config-source.ftp}\*.config"
    </echo>
    <echo file="${ftp.command.file}" append="true">
      exit
    </echo>

Executing the ftp.command.file

The next step is to execute the FTP Command file using the <exec/> task.  Use the WinSCP.com executable instead of WinSCP.exe as that is the one intended for use in batch/non-interactive programs:

    <exec program="WinSCP.com" basedir="${sftp.exec.dir}" >
      <arg value="/script=${ftp.command.file}"/>
    </exec>

The only other challenge is to grab the Fingerprint key to be used as input for the -hostkey parameter. This can be done by connecting to the SFTP server from the WinSCP console interface and copying it using the "Copy Key" button below:

Click Copy Key Button

Trackback Link
http://www.oshyn.com/BlogRetrieve.aspx?BlogID=1907&PostID=218725&A=Trackback
Trackbacks
Post has no trackbacks.

Pages: Previous Next

TwitterFacebookLinkedIn
ajax rotator

Blog Authors

Christian Burne Christian Burne
Subscribe Subscribe Subscribe Subscribe Subscribe
OTHER CATEGORIES
  • ALL

  • General

  • Web Content Management

  • Sitecore CMS

  • Open Text

  • Jahia

  • Drupal

  • EpiServer

  • SOA

  • Social Media and Mobile

  • Software Development

  • Visit Bloggers Profiles

RELATED POSTS
  • Introduction to Jahia's RSS Social Component Module
  • Using the Jahia Admin Tool
  • EPiServer Property Configuration with PageTypeBuilder
  • Sitecore Navigation Using Renderings
  • EPiServer Tab Assignment with PageTypeBuilder
  • Introduction to Jahia JCR Query Languages
  • Installation Tips for a Jahia Setup on Linux OS
  • What to Expect When Implementing a New CMS
  • Creating a Simple EPiServer Page Type Hierarchy Using PageTypeBuilder
  • PageTypeBuilder for EPiServer

WHITE PAPERS

    Web Content Management, Social Media, Content: Three Kings for Your Website Web Content Management, Social Media, Content: Three Kings for Your Website (846 KB)
    Companies pursuing online marketing success, including Social Media, can increase the power of their online presence with right strategy and technology to maximize online visibility and engagement. Download this FREE white paper on the WCM, Social Media, and Content triad.

    Drupal Performance Tuning Drupal Performance Tuning (1213 KB)
    In this Free White Paper Oshyn evaluates Drupal Performance Tuning, sharing the results of testing response time and Requests Per Second (RPS) that a server can hold before the response rate becomes unacceptable. In this paper you will learn about optimizing performance of a website through changes to settings and the server.

    Enterprise Drupal: Social Media, Mobile, and Rich Media in your Website Enterprise Drupal: Social Media, Mobile, and Rich Media in your Website (1015 KB)
    In this free WCM white paper, Oshyn examines advanced Drupal capabilities: Multisite Environment, Access Control and Security, Enhanced User Profiles, Custom Breadcrumbs, Mobile Support, Podcasts, Advanced Multimedia, Locations and Maps, Internationalization and Locale based content, Events and Scheduled Tasks, Rules Actions and E-Commerce Solutions.

    Drupal Multilingual Drupal Multilingual (636 KB)
    There are several multilingual installation methods for Drupal. In this free white paper Oshyn evaluates and recommends several methods of using Drupal Open Source CMS to manage websites in multiple languages.

    Drupal Social Media Drupal Social Media (1297 KB)
    Looking for an Open Source CMS to for “Social Media Optimization” of your website? Download this free white paper, “Drupal and Social Media”, to learn about the extensive Social Media this Open Source CMS offers to create a dynamic and engaging website and online community.

    Drupal Multisite Options Drupal Multisite Options (427 KB)
    There are several multisite installation methods for Drupal. In this free white paper Oshyn evaluates and recommends several methods of using Drupal Open Source CMS to manage multiple sites.

    Open Source CMS: Is It Right for your Organization Open Source CMS: Is It Right for your Organization (496 KB)
    In this free white paper, “Open Source CMS: Is It Right for your Organization?” we share an in-depth look at the pros and cons of using Open Source Content Management Systems (CMS) or Open Source Web Content Management (WCM) platforms. Oshyn helps clients select CMS/WCM solutions based on the specific requirements of each client.

    Affiliate Content Sharing in a CMS/WCM World Affiliate Content Sharing in a CMS/WCM World (273 KB)
    The Content Editors at your company have created GREAT content! Now how do you share it? In this Free white paper learn several methods for using a Content Syndication tool to automatically repurpose content and how Content Sharing can generate business value.

    Sitecore and Social Media - An Interactive Web Content Management Platform Sitecore and Social Media - An Interactive Web Content Management Platform (898 KB)
    Social Media has revolutionized how people interact with business. In this white paper Oshyn’s Lead Sitecore Developer, Prasanth Nittala, discusses key points from the perspectives of marketing and Web development that make Sitecore a compelling choice for engaging in Social Media via your website. This Sitecore white paper draws from Oshyn’s expertise as a certified Sitecore partner, helping organizations understand the distinct capabilities offered by Sitecore CMS.

    The Business Case for Leveraging Open Text Web Solutions Delivery Manager The Business Case for Leveraging Open Text Web Solutions Delivery Manager (451 KB)
    This free white paper explores the evolving needs of small and medium size businesses and explains how the Open Text Web Solutions Delivery Manager (formerly RedDot LiveServer) can help businesses build their brand, reputation, and client base. This white paper examines strategies, key points and tips to leverage the features available in Open Text Web Solutions (RedDot CMS) to achieve an impactful user experience and to maximize visitor engagement through a reliable and powerful implementation.

    Open Text Best Practices: Part One Open Text Best Practices: Part One (763 KB)
    Authored by Oshyn Senior Consultant, Adaeze Okorie, this free CMS white paper draws from Oshyn’s vast experience as an Open Text Certified Partner, in helping organizations define strategies to meet business goals while implementing Open Text Web Solutions (RedDot CMS). Specifically in this free white paper Adaeze Okorie discusses strategies, key points and tips to leverage the features available in Open Text Web Solutions (RedDot CMS) to achieve an effective, reliable and robust implementation.

    Improving the ROI of Business Software: Service Oriented Architecture from a Business Perspective Improving the ROI of Business Software: Service Oriented Architecture from a Business Perspective (398 KB)
    Software selection and technology decision making should no longer be left to the IT department alone. By gaining an understanding of Service-Oriented Architecture, business people outside of the IT department will be better positioned to maximize the ROI of the company's technology platforms. Download this free white paper to learn more.

    Getting Over Social Media Marketing Paralysis for B2B Getting Over Social Media Marketing Paralysis for B2B (2254 KB)
    Many companies are well aware that Social Media has become critically important to engaging audiences and promoting online "presence" while some wonder how to approach their C-level executives and prove that it is not all hype. With so many ways to engage in Social Media, how can they get buy-in and begin execution with so many different venues and tools available? Staying on the sidelines and becoming a latecomer might make it more difficult to create a convincing "social" presence. Put the ove

    Performance Tuning Open Text Web Solutions Management Server and Delivery Server Performance Tuning Open Text Web Solutions Management Server and Delivery Server (235 KB)
    If you've made an investment in Open Text Web Solutions (formerly RedDot) Web Content Management products, you’ve undoubtedly experienced performance issues. While every CMS requires tuning, Open Text Web Solutions - RedDot is especially susceptible to mis-configuration and poor performance as the out-of-the-box installation comes untuned and ready for Development Environments only. In this FREE white paper we share performance tuning expertise as an Open Text Certified Partner that has optimize

    The Business Case for Leveraging Open Text Web Solutions Within Higher Education The Business Case for Leveraging Open Text Web Solutions Within Higher Education (430 KB)
    Academic institutions have a long reputation for being slower to adopt new technologies for their audiences. However, many schools are taking serious steps in improving the online experience they are providing. This white paper explores the unique needs of the higher education market, applying new tools & trends and specifically how the Open Text Web Solutions’ Delivery Manager (formerly known as RedDot LiveServer) can be leveraged to achieve those goals.

    SEO Best Practices within a Content Management System SEO Best Practices within a Content Management System (712 KB)
    In this free white paper, we share Search Engine Optimization (SEO) tips and best practices to follow when implementing a Content Management System (CMS). Certain features and functionality will help your content editors make website changes faster while minimizing the risk of human error. Download this free white paper to learn strategies to improve search engine rankings.

    Best Practices for Sitecore CMS Best Practices for Sitecore CMS (1121 KB)
    Sitecore CMS is an extensive Web Content Management (WCM) platform for the mid-market. It offers reduced IT expenditures, a streamlined content lifecycle, and a return of content control to the subject matter experts. The newest incarnation of Sitecore CMS version 6.0 is a mature product that incorporates standard social media components such as wikis, blogs, RSS syndication and “e-mail a friend” features.

    Optimizing SEO in your CMS (WCM) Optimizing SEO in your CMS (WCM) (3108 KB)
    Oshyn's Christian Burne spoke in depth about SEO in CMS at the Gilbane San Francisco Conference on June 3rd, 2009. Christian discussed the pressues of keyword competition and how the CMS can add tremendous power to climbing Google SERPs and other search engine rankings. The presentation was later part of a featured article on CMSWire. We've made the presentation available in PDF format. Download now to learn more about strategies for using your CMS to optimize SEO.

    The Best CMS for You: Tips on How to Select Your Next CMS The Best CMS for You: Tips on How to Select Your Next CMS (909 KB)
    As websites continue to grow in size, features and functionality, the visitors to these websites are also becoming more demanding and have higher expectations than ever before. Companies who committed valuable time and resources to web strategies just five years ago are finding they must re-evaluate and explore new options as their content, features and online offerings must keep pace with the constant and rapid movement in the digital marketplace. For many of these companies, there is a strong.

    Oshyn Sample Voluntary Product Accessibility Template (VPAT) Oshyn Sample Voluntary Product Accessibility Template (VPAT) (741 KB)
    Section 508 requires that when federal government and agencies procure, develop, and maintain or use electronic and information technology (EIT), they must ensure that it is accessible and in compliance with Section 508 standards developed by the Architectural and Transportation Barriers Compliance Board (Access Board). Oshyn understands these requirements and has delivered reports like these countless times.

    Sitecore CMS Implementation Best Practices Sitecore CMS Implementation Best Practices (481 KB)

    Twitter Facebook LinkedIn Featured in Alltop
    question button image

     



    Captcha Image

    question button image
    Oshyn, Inc.17785 Center Court Drive N Cerritos, CA 90703    1.888.483.1770 newbusiness@oshyn.com
    2012 Copyright Oshyn. All rights reserved.
    • View Mobile Version
    • Terms of Use
    • Privacy Policy
    • Contact Us
    x
    • Contact Us Oshyn 1.888.483.1770
      Have Oshyn Call Me Have Oshyn call you
      Request Further Information Request further information

      Submit an RFP Submit an RFP